Sep 10 19:58:10 devstack cinder-volume[77170]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 19:58:10 devstack cinder-volume[77170]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 19:58:10 devstack cinder-volume[77170]: we strongly recommend against using it for new projects. Sep 10 19:58:10 devstack cinder-volume[77170]: If you are already using Eventlet, we recommend migrating to a different Sep 10 19:58:10 devstack cinder-volume[77170]: framework. For more detail see Sep 10 19:58:10 devstack cinder-volume[77170]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 19:58:10 devstack cinder-volume[77170]: import eventlet # noqa Sep 10 19:58:14 devstack cinder-volume[77170]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 19:58:14 devstack cinder-volume[77170]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 19:58:14 devstack cinder-volume[77170]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 19:58:14 devstack cinder-volume[77170]: INFO dbcounter [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Registered counter for database cinder Sep 10 19:58:14 devstack cinder-volume[77170]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77170) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:58:15 devstack cinder-volume[77170]: DEBUG dbcounter [-] [77170] Writer thread running {{(pid=77170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 19:58:15 devstack cinder-volume[77170]: INFO cinder.rpc [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 19:58:15 devstack cinder-volume[77170]: INFO cinder.rpc [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 19:58:15 devstack cinder-volume[77170]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77170) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:58:15 devstack cinder-volume[77170]: INFO cinder.volume.manager [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Determined volume DB was empty at startup. Sep 10 19:58:15 devstack cinder-volume[77170]: DEBUG cinder.volume.manager [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77170) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 19:58:15 devstack cinder-volume[77170]: INFO cinder.volume.manager [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 19:58:15 devstack cinder-volume[77170]: WARNING stevedore.named [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 19:58:15 devstack cinder-volume[77170]: WARNING castellan.key_manager [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:58:15 devstack cinder-volume[77170]: WARNING cinder.keymgr.conf_key_mgr [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:58:15 devstack cinder-volume[77170]: DEBUG cinder.volume.drivers.lvm [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77170) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 10 19:58:15 devstack cinder-volume[77170]: DEBUG oslo_concurrency.processutils [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_concurrency.processutils [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] CMD "cinder-rtstool verify" returned: 0 in 0.616s {{(pid=77170) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77170) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:58:16 devstack cinder-volume[77170]: INFO cinder.rpc [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 10 19:58:16 devstack cinder-volume[77170]: INFO cinder.rpc [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 10 19:58:16 devstack cinder-volume[77170]: WARNING stevedore.named [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 19:58:16 devstack cinder-volume[77170]: WARNING castellan.key_manager [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 19:58:16 devstack cinder-volume[77170]: INFO cinder.volume.manager [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77170) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:58:16 devstack cinder-volume[77170]: INFO oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Starting 1 workers Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Started child 77314 {{(pid=77170) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Full set of CONF: {{(pid=77170) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] ******************************************************************************** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Configuration options gathered from: {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] ================================================================================ {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] allow_availability_zone_fallback = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] allow_compression_on_image_upload = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] allowed_direct_url_schemes = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] api_rate_limit = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] auth_strategy = keystone {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] az_cache_duration = 3600 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_availability_zone = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_host = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77314]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_stats_polling_interval = 60 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backup_api_class = cinder.backup.api.API {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backup_name_template = backup-%s {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backup_use_same_host = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backup_use_temp_snapshot = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] chap_password = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] chap_username = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cinder_internal_tenant_project_id = 29b6cb7abac94e0fb8c42a266660e316 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cinder_internal_tenant_user_id = 79997a13f3ff4405be60e74e56edcce0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cloned_volume_same_az = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cluster = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] compression_format = gzip {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] compute_api_class = cinder.compute.nova.API {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] config_dir = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] config_source = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] control_exchange = openstack {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] debug = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] default_availability_zone = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] default_group_type = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] default_volume_type = lvmdriver-1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] disk_geometry = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] driver_client_cert = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] driver_client_cert_key = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] driver_data_namespace = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] driver_ssl_cert_path = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] driver_ssl_cert_verify = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] driver_use_ssl = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] enable_force_upload = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] enable_new_services = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] enable_unsupported_driver = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] enabled_backends = ['lvmdriver-1'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] enforce_multipath_for_image_xfer = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] filter_function = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_api_insecure = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_api_servers = ['http://192.168.122.91/image'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_api_ssl_compression = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_ca_certificates_file = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_catalog_info = image:glance:publicURL {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_certfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_keyfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_num_retries = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance_request_timeout = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] goodness_function = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] graceful_shutdown_timeout = 5 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] group_api_class = cinder.group.api.API {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] host = devstack {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_compress_on_upload = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_conversion_address_space_limit = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_conversion_cpu_limit = 60 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_conversion_disable = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_upload_use_cinder_backend = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_upload_use_internal_tenant = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_volume_cache_enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_volume_cache_max_count = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] image_volume_cache_max_size_gb = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] init_host_max_objects_retrieval = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] instance_format = [instance: %(uuid)s] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] iscsi_target_flags = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] iscsi_write_cache = on {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] iser_helper = tgtadm {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] iser_ip_address = 192.168.122.91 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] iser_port = 3260 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] log_color = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] log_config_append = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] log_dir = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] log_file = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] log_options = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] log_rotate_interval = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] log_rotate_interval_type = days {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] log_rotation_type = none {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] max_age = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] max_logfile_count = 30 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] max_logfile_size_mb = 200 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] max_over_subscription_ratio = 20.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] message_reap_interval = 86400 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] message_ttl = 2592000 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] migration_create_volume_timeout_secs = 300 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] monkey_patch = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] monkey_patch_modules = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] my_ip = 192.168.122.91 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] no_snapshot_gb_quota = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] num_iser_scan_tries = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] num_shell_tries = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] num_volume_device_scan_tries = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] nvmeof_conn_info_version = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] nvmet_ns_id = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] nvmet_port_id = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] osapi_max_limit = 1000 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77314]: INFO cinder.volume.manager [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] osapi_volume_ext_list = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] osapi_volume_listen = 0.0.0.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] osapi_volume_listen_port = 8776 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] osapi_volume_use_ssl = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] osapi_volume_workers = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] per_volume_size_limit = -1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] periodic_fuzzy_delay = 60 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] periodic_interval = 60 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] project_id_regex = [0-9a-f\-]+ {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] public_endpoint = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] publish_errors = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] quota_backup_gigabytes = 1000 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] quota_backups = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] quota_gigabytes = 1000 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] quota_groups = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] quota_snapshots = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] quota_volumes = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] rate_limit_burst = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] rate_limit_except_level = CRITICAL {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] rate_limit_interval = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] reinit_driver_count = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] replication_device = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] report_discard_supported = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] report_interval = 120 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] reservation_clean_interval = 86400 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] reservation_expire = 86400 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] reserved_image_namespaces = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] reserved_percentage = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] rpc_response_timeout = 120 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] run_external_periodic_tasks = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] scst_target_driver = iscsi {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] scst_target_iqn_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_down_time = 720 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] shell_completion = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] snapshot_name_template = snapshot-%s {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] snapshot_same_host = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] split_loggers = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] state_path = /opt/stack/data/cinder {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] storage_availability_zone = nova {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] storage_protocol = iSCSI {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] syslog_log_facility = LOG_USER {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] target_helper = lioadm {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] target_ip_address = 192.168.122.91 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] target_port = 3260 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] target_protocol = iscsi {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] target_secondary_ip_addresses = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] trace_flags = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] transfer_api_class = cinder.transfer.api.API {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] transport_url = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] until_refresh = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] use_chap_auth = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] use_default_quota_class = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] use_journal = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] use_json = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] use_multipath_for_image_xfer = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] use_stderr = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] use_syslog = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] verify_glance_signatures = enabled {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_api_class = cinder.volume.api.API {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_backend_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_clear = zero {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_clear_ionice = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_clear_size = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_copy_bps_limit = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_dd_blocksize = 1M {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_name_template = volume-%s {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_service_inithost_offload = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volume_usage_audit_period = month {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] zoning_mode = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_concurrency.disable_process_locking = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.auth_section = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.auth_type = password {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.auth_version = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.cache = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.certfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.delay_auth_decision = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.http_connect_timeout = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.include_service_catalog = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.insecure = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.interface = public {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.keyfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_password = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcache_username = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.region_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.service_token_roles_required = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.service_type = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.token_cache_time = 300 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.backend = dogpile.cache.null {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.backend_argument = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.backend_expiration_time = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.config_prefix = cache.oslo {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.debug_cache_backend = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.enable_retry_client = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.enable_socket_keepalive = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.expiration_time = 600 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.hashclient_retry_attempts = 2 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.memcache_dead_retry = 300 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.memcache_pool_maxsize = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.memcache_sasl_enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.password = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.proxies = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.redis_db = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.redis_sentinel_service_name = mymaster {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.redis_server = localhost:6379 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.retry_attempts = 2 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.retry_delay = 0.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.socket_keepalive_count = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.socket_keepalive_idle = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.socket_keepalive_interval = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.socket_timeout = 1.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.tls_allowed_ciphers = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.tls_cafile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.tls_certfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.tls_enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.tls_keyfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cache.username = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] coordination.backend_url = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.asyncio_connection = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.asyncio_slave_connection = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.backend = sqlalchemy {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.connection = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.connection_debug = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.connection_parameters = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.connection_recycle_time = 3600 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.connection_trace = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.db_inc_retry_interval = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.db_max_retries = 20 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.db_max_retry_interval = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.db_retry_interval = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.max_overflow = 50 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.max_pool_size = 5 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.max_retries = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.mysql_wsrep_sync_wait = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.pool_timeout = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.retry_interval = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.slave_connection = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.sqlite_synchronous = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.synchronous_reader = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] database.use_db_reconnect = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_tracing.insecure = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.connection_string = messaging:// {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.es_doc_type = notification {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.es_scroll_size = 10000 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.es_scroll_time = 2m {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.filter_error_trace = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.hmac_keys = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.sentinel_service_name = mymaster {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.socket_timeout = 0.1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.trace_requests = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler.trace_sqlalchemy = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler_jaeger.process_tags = {} {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler_jaeger.service_name_prefix = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] profiler_otlp.service_name_prefix = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.enforce_new_defaults = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.policy_default_rule = default {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.policy_file = policy.yaml {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_policy.remote_timeout = 60.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] privsep_osbrick.group = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] privsep_osbrick.helper_command = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] privsep_osbrick.user = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cinder_sys_admin.group = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cinder_sys_admin.helper_command = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] cinder_sys_admin.user = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.auth_section = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.auth_type = password {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:16 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.cafile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.certfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.collect_timing = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.insecure = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.keyfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.send_service_user_token = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.split_loggers = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.timeout = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.tls_ciphers = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] service_user.tls_min_version = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.auth_section = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.auth_type = password {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.certfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.collect_timing = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.insecure = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.keyfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.region_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.split_loggers = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.timeout = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.tls_ciphers = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] glance.tls_min_version = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.backend_availability_zone = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.chap_password = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.chap_username = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.disk_geometry = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.driver_client_cert = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.driver_client_cert_key = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.driver_data_namespace = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.driver_use_ssl = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.enable_unsupported_driver = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.extra_capabilities = {} {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.filter_function = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.goodness_function = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.iscsi_target_flags = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.iscsi_write_cache = on {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.iser_helper = tgtadm {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.iser_port = 3260 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.lvm_mirrors = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.lvm_share_target = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.lvm_type = auto {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.num_shell_tries = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.nvmet_port_id = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.replication_device = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.report_discard_supported = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.reserved_percentage = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.scst_target_driver = iscsi {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.scst_target_iqn_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.storage_protocol = iSCSI {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.target_helper = tgtadm {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack sudo[77367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.target_port = 3260 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.target_protocol = iscsi {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.trace_flags = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack sudo[77367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.unique_fqdn_network = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.use_chap_auth = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volume_backend_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volume_clear = zero {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volume_clear_ionice = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volume_clear_size = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volume_group = cinder-volumes {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_reports.file_event_handler = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_reports.log_dir = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.backend_availability_zone = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.backend_host = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.chap_password = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.chap_username = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.chiscsi_conf = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.disk_geometry = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.driver_client_cert = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.driver_data_namespace = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.driver_use_ssl = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.extra_capabilities = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.filter_function = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.goodness_function = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.iser_helper = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.iser_ip_address = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.iser_port = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.iser_target_prefix = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.lvm_conf_file = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.lvm_mirrors = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.lvm_share_target = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.lvm_type = auto {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.num_shell_tries = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.nvmet_port_id = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.replication_device = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.report_discard_supported = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.reserved_percentage = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.scst_target_driver = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.storage_protocol = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.target_helper = lioadm {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.target_ip_address = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.target_port = 3260 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.target_protocol = iscsi {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.trace_flags = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.use_chap_auth = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volume_clear = zero {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volume_clear_size = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] lvmdriver-1.volumes_dir = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.ssl = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.ssl_version = {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_notifications.driver = [] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_notifications.retry = -1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] oslo_messaging_notifications.transport_url = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] key_manager.fixed_key = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.barbican_api_version = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.barbican_endpoint = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.barbican_endpoint_type = public {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.barbican_region_name = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.cafile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.certfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.collect_timing = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.insecure = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.keyfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.number_of_retries = 60 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.retry_delay = 1 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.send_service_user_token = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.split_loggers = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.timeout = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.tls_ciphers = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.tls_min_version = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.verify_ssl = True {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican.verify_ssl_path = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.auth_section = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.auth_type = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.cafile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.certfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.collect_timing = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.insecure = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.keyfile = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.split_loggers = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.timeout = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.tls_ciphers = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] barbican_service_user.tls_min_version = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.approle_role_id = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.approle_secret_id = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.auth_method = approle {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.auth_path = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.kv_mountpoint = secret {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.kv_path = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.kv_version = 2 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.namespace = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.root_token_id = **** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.ssl_ca_crt_file = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.timeout = 60.0 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.token_file = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.token_role = None {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.use_ssl = False {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 19:58:16 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] ******************************************************************************** {{(pid=77170) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 19:58:17 devstack sudo[77367]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.372s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:17 devstack sudo[77504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:58:17 devstack sudo[77504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:17 devstack sudo[77504]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.312s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 19:58:17 devstack cinder-volume[77314]: INFO cinder.brick.local_dev.lvm [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:17 devstack sudo[77606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:58:17 devstack sudo[77606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:17 devstack sudo[77606]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG cinder.brick.local_dev.lvm [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77314) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 10 19:58:17 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:17 devstack sudo[77706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:58:17 devstack sudo[77706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:18 devstack sudo[77706]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:18 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.115s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:18 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:18 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:18 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:18 devstack sudo[78001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:58:18 devstack sudo[78001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:19 devstack sudo[78001]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:19 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:19 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:19 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:19 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:19 devstack sudo[78005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 10 19:58:19 devstack sudo[78005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:19 devstack sudo[78005]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:19 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.337s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:19 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:19 devstack sudo[78056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:58:19 devstack sudo[78056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:19 devstack sudo[78056]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:19 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:19 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:19 devstack sudo[78097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:58:19 devstack sudo[78097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:20 devstack sudo[78097]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:20 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:20 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:20 devstack sudo[78101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:58:20 devstack sudo[78101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:20 devstack sudo[78101]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:20 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:20 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:20 devstack sudo[78104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:58:20 devstack sudo[78104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:20 devstack sudo[78104]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:20 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:20 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:20 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:20 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:20 devstack sudo[78114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:58:20 devstack sudo[78114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:21 devstack sudo[78114]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:21 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:21 devstack cinder-volume[77314]: INFO cinder.volume.drivers.lvm [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 10 19:58:21 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:21 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:21 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:21 devstack sudo[78118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:58:21 devstack sudo[78118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:21 devstack sudo[78118]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:21 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:21 devstack cinder-volume[77314]: DEBUG cinder.volume.drivers.lvm [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Updating volume stats {{(pid=77314) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:58:21 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:21 devstack sudo[78122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:58:21 devstack sudo[78122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:21 devstack sudo[78122]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:21 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:21 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:21 devstack sudo[78125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:58:21 devstack sudo[78125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:22 devstack sudo[78125]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:22 devstack sudo[78129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:58:22 devstack sudo[78129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:22 devstack sudo[78129]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:22 devstack sudo[78133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:58:22 devstack sudo[78133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:22 devstack sudo[78133]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:22 devstack cinder-volume[77314]: INFO cinder.volume.driver [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Driver hasn't implemented _init_vendor_properties() Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG cinder.volume.driver [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77314) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77314) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG dbcounter [-] [77314] Writer thread running {{(pid=77314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG cinder.db.api [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Building query based on filter {{(pid=77314) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG cinder.image.image_utils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77314) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 19:58:22 devstack cinder-volume[77314]: INFO cinder.keymgr.migration [None req-d05edcab-d5a0-4c2d-981c-582e096099a2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG cinder.volume.drivers.lvm [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Updating volume stats {{(pid=77314) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:58:22 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:22 devstack sudo[78136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:58:22 devstack sudo[78136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:23 devstack sudo[78136]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:23 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:23 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:23 devstack sudo[78142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:58:23 devstack sudo[78142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:23 devstack sudo[78142]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:23 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:23 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:23 devstack sudo[78145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:58:23 devstack sudo[78145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:23 devstack sudo[78145]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:23 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:23 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:23 devstack sudo[78148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:58:23 devstack sudo[78148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:24 devstack sudo[78148]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:24 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:24 devstack cinder-volume[77314]: DEBUG cinder.manager [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Notifying Schedulers of capabilities ... {{(pid=77314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:58:24 devstack cinder-volume[77314]: INFO cinder.volume.manager [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Driver initialization completed successfully. Sep 10 19:58:24 devstack cinder-volume[77314]: INFO cinder.manager [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Initiating service 2 cleanup Sep 10 19:58:24 devstack cinder-volume[77314]: INFO cinder.manager [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Service 2 cleanup completed. Sep 10 19:58:24 devstack cinder-volume[77314]: DEBUG cinder.service [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Creating RPC server for service cinder-volume {{(pid=77314) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 19:58:24 devstack cinder-volume[77314]: DEBUG cinder.service [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77314) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 19:58:24 devstack cinder-volume[77314]: INFO cinder.volume.manager [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 10 19:58:24 devstack cinder-volume[77314]: DEBUG cinder.volume.drivers.lvm [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Updating volume stats {{(pid=77314) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:58:24 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:24 devstack sudo[78154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:58:24 devstack sudo[78154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:24 devstack sudo[78154]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:24 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:24 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:24 devstack sudo[78157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:58:24 devstack sudo[78157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:24 devstack sudo[78157]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:25 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:25 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:25 devstack sudo[78163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:58:25 devstack sudo[78163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:25 devstack sudo[78163]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:25 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.388s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:25 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:58:25 devstack sudo[78169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:58:25 devstack sudo[78169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:58:25 devstack sudo[78169]: pam_unix(sudo:session): session closed for user root Sep 10 19:58:25 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:58:25 devstack cinder-volume[77314]: INFO cinder.volume.manager [None req-f6b317ac-04e0-47d3-ab9c-a28d97090b1f None None] Driver post RPC initialization completed successfully. Sep 10 19:58:26 devstack cinder-volume[77170]: DEBUG dbcounter [-] [77170] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77170) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:58:35 devstack cinder-volume[77314]: DEBUG dbcounter [-] [77314] Writing DB stats cinder:SELECT=3 {{(pid=77314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:58:35 devstack cinder-volume[77314]: DEBUG dbcounter [-] [77314] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 19:58:52 devstack cinder-volume[77314]: DEBUG oslo_service.periodic_task [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running periodic task VolumeManager._thread_info {{(pid=77314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:58:52 devstack cinder-volume[77314]: DEBUG cinder.volume.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] thread count: 6 {{(pid=77314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:58:52 devstack cinder-volume[77314]: DEBUG cinder.volume.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] thread info: [<_MainThread(MainThread, started 140264117907584)>, , , , , ] {{(pid=77314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 19:59:52 devstack cinder-volume[77314]: DEBUG oslo_service.periodic_task [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:59:52 devstack cinder-volume[77314]: DEBUG cinder.volume.drivers.lvm [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Updating volume stats {{(pid=77314) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 19:59:52 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:52 devstack sudo[80766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 19:59:52 devstack sudo[80766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:53 devstack sudo[80766]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:53 devstack sudo[80769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:59:53 devstack sudo[80769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:53 devstack sudo[80769]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:53 devstack sudo[80772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 19:59:53 devstack sudo[80772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:53 devstack sudo[80772]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 19:59:53 devstack sudo[80775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 19:59:53 devstack sudo[80775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 19:59:53 devstack sudo[80775]: pam_unix(sudo:session): session closed for user root Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG cinder.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Notifying Schedulers of capabilities ... {{(pid=77314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG oslo_service.periodic_task [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running periodic task VolumeManager._thread_info {{(pid=77314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG cinder.volume.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] thread count: 6 {{(pid=77314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 19:59:53 devstack cinder-volume[77314]: DEBUG cinder.volume.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] thread info: [<_MainThread(MainThread, started 140264117907584)>, , , , , ] {{(pid=77314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:00:35 devstack cinder-volume[77314]: DEBUG dbcounter [-] [77314] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:00:52 devstack cinder-volume[77314]: DEBUG oslo_service.periodic_task [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:00:52 devstack cinder-volume[77314]: DEBUG cinder.volume.drivers.lvm [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Updating volume stats {{(pid=77314) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 20:00:52 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:52 devstack sudo[83712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:00:52 devstack sudo[83712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:53 devstack sudo[83712]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:53 devstack sudo[83716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:00:53 devstack sudo[83716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:53 devstack sudo[83716]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:53 devstack sudo[83721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:00:53 devstack sudo[83721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:53 devstack sudo[83721]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:00:53 devstack sudo[83724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:00:53 devstack sudo[83724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:00:53 devstack sudo[83724]: pam_unix(sudo:session): session closed for user root Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG cinder.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Notifying Schedulers of capabilities ... {{(pid=77314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG oslo_service.periodic_task [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running periodic task VolumeManager._thread_info {{(pid=77314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG cinder.volume.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] thread count: 6 {{(pid=77314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:00:53 devstack cinder-volume[77314]: DEBUG cinder.volume.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] thread info: [<_MainThread(MainThread, started 140264117907584)>, , , , , ] {{(pid=77314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:01:52 devstack cinder-volume[77314]: DEBUG oslo_service.periodic_task [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:01:52 devstack cinder-volume[77314]: DEBUG cinder.volume.drivers.lvm [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Updating volume stats {{(pid=77314) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 20:01:52 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:52 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:01:52 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:53 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:53 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:01:53 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:53 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:53 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:01:53 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:53 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:01:53 devstack sudo[85626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:01:53 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:01:53 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG cinder.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Notifying Schedulers of capabilities ... {{(pid=77314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG oslo_service.periodic_task [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running periodic task VolumeManager._thread_info {{(pid=77314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG cinder.volume.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] thread count: 6 {{(pid=77314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:01:53 devstack cinder-volume[77314]: DEBUG cinder.volume.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] thread info: [<_MainThread(MainThread, started 140264117907584)>, , , , , ] {{(pid=77314) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:02:35 devstack cinder-volume[77314]: DEBUG dbcounter [-] [77314] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77314) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:02:52 devstack cinder-volume[77314]: DEBUG oslo_service.periodic_task [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77314) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:02:52 devstack cinder-volume[77314]: DEBUG cinder.volume.drivers.lvm [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Updating volume stats {{(pid=77314) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 20:02:52 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:52 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 20:02:52 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:53 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:53 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:02:53 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:53 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.350s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:53 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 20:02:53 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:53 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:53 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:02:53 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 20:02:53 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:02:54 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Sep 10 20:02:54 devstack cinder-volume[77314]: DEBUG oslo_concurrency.processutils [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=77314) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:02:54 devstack cinder-volume[77314]: DEBUG cinder.manager [None req-5c278530-aae4-4ff0-864f-d23271f7ce93 None None] Notifying Schedulers of capabilities ... {{(pid=77314) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:19 devstack cinder-volume[77170]: INFO oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Caught SIGTERM, stopping children Sep 10 20:03:19 devstack cinder-volume[77170]: DEBUG oslo_concurrency.lockutils [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Acquiring lock "singleton_lock" {{(pid=77170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 20:03:19 devstack cinder-volume[77170]: DEBUG oslo_concurrency.lockutils [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Acquired lock "singleton_lock" {{(pid=77170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 20:03:19 devstack cinder-volume[77170]: DEBUG oslo_concurrency.lockutils [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Releasing lock "singleton_lock" {{(pid=77170) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 20:03:19 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Stop services. {{(pid=77170) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 10 20:03:19 devstack cinder-volume[77170]: DEBUG oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Killing children. {{(pid=77170) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 10 20:03:19 devstack cinder-volume[77170]: INFO oslo_service.backend._eventlet.service [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Waiting on 1 children to exit Sep 10 20:03:24 devstack cinder-volume[77314]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 10 20:03:24 devstack cinder-volume[87363]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 20:03:24 devstack cinder-volume[87363]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 20:03:24 devstack cinder-volume[87363]: we strongly recommend against using it for new projects. Sep 10 20:03:24 devstack cinder-volume[87363]: If you are already using Eventlet, we recommend migrating to a different Sep 10 20:03:24 devstack cinder-volume[87363]: framework. For more detail see Sep 10 20:03:24 devstack cinder-volume[87363]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 20:03:24 devstack cinder-volume[87363]: import eventlet # noqa Sep 10 20:03:27 devstack cinder-volume[87363]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 20:03:27 devstack cinder-volume[87363]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 20:03:27 devstack cinder-volume[87363]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 20:03:28 devstack cinder-volume[87363]: INFO dbcounter [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Registered counter for database cinder Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_db.sqlalchemy.engines [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG dbcounter [-] [87363] Writer thread running {{(pid=87363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 20:03:28 devstack cinder-volume[87363]: INFO cinder.rpc [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 20:03:28 devstack cinder-volume[87363]: INFO cinder.rpc [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_db.sqlalchemy.engines [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 20:03:28 devstack cinder-volume[87363]: INFO cinder.volume.manager [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Determined volume DB was empty at startup. Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG cinder.volume.manager [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87363) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 20:03:28 devstack cinder-volume[87363]: INFO cinder.volume.manager [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 20:03:28 devstack cinder-volume[87363]: WARNING stevedore.named [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 20:03:28 devstack cinder-volume[87363]: WARNING castellan.key_manager [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 20:03:28 devstack cinder-volume[87363]: WARNING cinder.keymgr.conf_key_mgr [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 20:03:28 devstack cinder-volume[87363]: INFO cinder.volume.manager [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_db.sqlalchemy.engines [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 20:03:28 devstack cinder-volume[87363]: INFO oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Starting 1 workers Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Started child 87581 {{(pid=87363) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Full set of CONF: {{(pid=87363) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] ******************************************************************************** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Configuration options gathered from: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] ================================================================================ {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] allow_availability_zone_fallback = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] allow_compression_on_image_upload = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] allowed_direct_url_schemes = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] api_rate_limit = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] auth_strategy = keystone {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87581]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_availability_zone = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_host = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_stats_polling_interval = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backup_api_class = cinder.backup.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backup_name_template = backup-%s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backup_use_same_host = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backup_use_temp_snapshot = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] chap_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] chap_username = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cinder_internal_tenant_project_id = 29b6cb7abac94e0fb8c42a266660e316 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cinder_internal_tenant_user_id = 79997a13f3ff4405be60e74e56edcce0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cluster = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] compression_format = gzip {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] compute_api_class = cinder.compute.nova.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] config_dir = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] config_source = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] control_exchange = openstack {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] debug = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] default_availability_zone = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] default_group_type = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] default_volume_type = QuobyteHD {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] disk_geometry = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] driver_client_cert = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] driver_client_cert_key = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] driver_data_namespace = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] driver_ssl_cert_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] driver_ssl_cert_verify = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] driver_use_ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] enable_new_services = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] enable_unsupported_driver = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] enabled_backends = ['QuobyteHD'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] enforce_multipath_for_image_xfer = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] filter_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_api_insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_api_servers = ['http://192.168.122.91/image'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_api_ssl_compression = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_ca_certificates_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_catalog_info = image:glance:publicURL {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_num_retries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance_request_timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] goodness_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] graceful_shutdown_timeout = 5 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] group_api_class = cinder.group.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] host = devstack {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_compress_on_upload = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_conversion_address_space_limit = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_conversion_cpu_limit = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_conversion_disable = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_upload_use_cinder_backend = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_upload_use_internal_tenant = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_volume_cache_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_volume_cache_max_count = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] image_volume_cache_max_size_gb = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] init_host_max_objects_retrieval = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] instance_format = [instance: %(uuid)s] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] iscsi_target_flags = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] iscsi_write_cache = on {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] iser_helper = tgtadm {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] iser_ip_address = 192.168.122.91 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] iser_port = 3260 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] log_color = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] log_config_append = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] log_dir = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] log_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] log_options = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] log_rotate_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] log_rotate_interval_type = days {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] log_rotation_type = none {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] max_age = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] max_logfile_count = 30 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] max_logfile_size_mb = 200 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] max_over_subscription_ratio = 20.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] message_reap_interval = 86400 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] message_ttl = 2592000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] migration_create_volume_timeout_secs = 300 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] monkey_patch = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] monkey_patch_modules = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] my_ip = 192.168.122.91 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] no_snapshot_gb_quota = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] num_iser_scan_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] num_shell_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] num_volume_device_scan_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] nvmeof_conn_info_version = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] nvmet_ns_id = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] nvmet_port_id = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] osapi_max_limit = 1000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:28 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] osapi_volume_ext_list = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] osapi_volume_listen_port = 8776 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] osapi_volume_use_ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] osapi_volume_workers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] per_volume_size_limit = -1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] periodic_fuzzy_delay = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] periodic_interval = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] public_endpoint = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] publish_errors = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] quota_backup_gigabytes = 1000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] quota_backups = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87581]: INFO cinder.volume.manager [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Starting volume driver QuobyteDriver (1.2) Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] quota_gigabytes = 1000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] quota_groups = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] quota_snapshots = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.remotefs [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87581) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] quota_volumes = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] rate_limit_burst = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] rate_limit_except_level = CRITICAL {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] rate_limit_interval = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] reinit_driver_count = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] replication_device = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] report_discard_supported = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] report_interval = 120 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] reservation_clean_interval = 86400 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] reservation_expire = 86400 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] reserved_image_namespaces = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] reserved_percentage = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] rpc_response_timeout = 120 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] run_external_periodic_tasks = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] scst_target_driver = iscsi {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] scst_target_iqn_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_down_time = 720 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] shell_completion = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] snapshot_name_template = snapshot-%s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] state_path = /opt/stack/data/cinder {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] storage_availability_zone = nova {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] storage_protocol = iSCSI {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] syslog_log_facility = LOG_USER {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] target_helper = lioadm {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] target_ip_address = 192.168.122.91 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] target_port = 3260 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] target_protocol = iscsi {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] target_secondary_ip_addresses = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] trace_flags = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] transport_url = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] until_refresh = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] use_chap_auth = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] use_default_quota_class = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] use_journal = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] use_json = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] use_multipath_for_image_xfer = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] use_stderr = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] use_syslog = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] verify_glance_signatures = enabled {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_api_class = cinder.volume.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_backend_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_clear = zero {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_clear_ionice = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_clear_size = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_copy_bps_limit = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_dd_blocksize = 1M {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_name_template = volume-%s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_service_inithost_offload = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volume_usage_audit_period = month {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] zoning_mode = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_concurrency.disable_process_locking = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.auth_section = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.auth_type = password {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.auth_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.cache = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.include_service_catalog = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87581) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 10 20:03:29 devstack cinder-volume[87581]: WARNING cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 10 20:03:29 devstack cinder-volume[87581]: WARNING cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.interface = public {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Running cmd (subprocess): mount.quobyte {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcache_username = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.region_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.service_type = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.backend = dogpile.cache.null {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.backend_argument = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.backend_expiration_time = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.config_prefix = cache.oslo {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.debug_cache_backend = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.enable_retry_client = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.enable_socket_keepalive = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.expiration_time = 600 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.hashclient_retry_attempts = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.memcache_dead_retry = 300 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.memcache_pool_maxsize = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.memcache_sasl_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.proxies = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.redis_db = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.redis_server = localhost:6379 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.retry_attempts = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.retry_delay = 0.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.socket_keepalive_count = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.socket_keepalive_idle = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.socket_keepalive_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.socket_timeout = 1.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.tls_allowed_ciphers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.tls_cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.tls_certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.tls_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.tls_keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cache.username = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] coordination.backend_url = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.asyncio_connection = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.asyncio_slave_connection = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.backend = sqlalchemy {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.connection = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.connection_debug = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.connection_parameters = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.connection_recycle_time = 3600 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.connection_trace = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.db_inc_retry_interval = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.db_max_retries = 20 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.db_max_retry_interval = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.db_retry_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.max_overflow = 50 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.max_pool_size = 5 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.max_retries = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.mysql_wsrep_sync_wait = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.pool_timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.retry_interval = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.slave_connection = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.sqlite_synchronous = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.synchronous_reader = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] database.use_db_reconnect = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_tracing.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.connection_string = messaging:// {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.es_doc_type = notification {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.es_scroll_size = 10000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.es_scroll_time = 2m {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack quobyte-client[87586]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 20:03:29 devstack quobyte-client[87586]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.filter_error_trace = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.hmac_keys = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.sentinel_service_name = mymaster {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.socket_timeout = 0.1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=87581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.trace_requests = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler.trace_sqlalchemy = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87581]: INFO cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 ... Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 -c /etc/quobyte/client-cinder.cfg {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler_jaeger.process_tags = {} {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler_jaeger.service_name_prefix = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] profiler_otlp.service_name_prefix = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.enforce_new_defaults = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.policy_default_rule = default {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.policy_file = policy.yaml {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] privsep_osbrick.group = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] privsep_osbrick.helper_command = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] privsep_osbrick.user = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cinder_sys_admin.group = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cinder_sys_admin.helper_command = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] cinder_sys_admin.user = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.auth_section = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.auth_type = password {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 -c /etc/quobyte/client-cinder.cfg Sep 10 20:03:29 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.collect_timing = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.send_service_user_token = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.tls_ciphers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] service_user.tls_min_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.auth_section = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.auth_type = password {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.collect_timing = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.region_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.tls_ciphers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] glance.tls_min_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.backend_availability_zone = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.chap_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.chap_username = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.disk_geometry = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.driver_client_cert = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.driver_client_cert_key = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.driver_data_namespace = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.driver_use_ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.extra_capabilities = {} {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.filter_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.goodness_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.iscsi_target_flags = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.iscsi_write_cache = on {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.iser_helper = tgtadm {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.iser_port = 3260 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_host = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_login = admin {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_mount_options = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_private_key = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_share_path = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.num_shell_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.quobyte_volume_url = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.replication_device = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.report_discard_supported = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.reserved_percentage = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.target_helper = tgtadm {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.target_port = 3260 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.target_protocol = iscsi {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.trace_flags = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.unique_fqdn_network = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.use_chap_auth = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.volume_backend_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.volume_clear = zero {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.volume_clear_ionice = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.volume_clear_size = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_reports.file_event_handler = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_reports.log_dir = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.backend_availability_zone = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.backend_host = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.chap_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.chap_username = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.chiscsi_conf = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.disk_geometry = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.driver_client_cert = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.driver_data_namespace = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.driver_use_ssl = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.extra_capabilities = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.filter_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.goodness_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.iser_helper = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.iser_ip_address = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.iser_port = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.iser_target_prefix = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_host = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_login = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_mount_options = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_private_key = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_share_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_ssh_port = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.num_shell_tries = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.nvmet_port_id = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.replication_device = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.report_discard_supported = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.reserved_percentage = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.scst_target_driver = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.storage_protocol = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.target_helper = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.target_ip_address = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.target_port = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.target_prefix = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.target_protocol = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.trace_flags = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.use_chap_auth = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.volume_clear = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.volume_clear_size = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] QuobyteHD.volumes_dir = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[77314]: DEBUG oslo_concurrency.lockutils [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Acquiring lock "singleton_lock" {{(pid=77314) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 20:03:29 devstack cinder-volume[77314]: DEBUG oslo_concurrency.lockutils [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Acquired lock "singleton_lock" {{(pid=77314) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 20:03:29 devstack cinder-volume[77314]: DEBUG oslo_concurrency.lockutils [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Releasing lock "singleton_lock" {{(pid=77314) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_notifications.driver = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_notifications.retry = -1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] key_manager.fixed_key = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.barbican_api_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.barbican_endpoint = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.barbican_endpoint_type = public {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.barbican_region_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.collect_timing = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.number_of_retries = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.retry_delay = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.send_service_user_token = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.tls_ciphers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[77314]: WARNING amqp [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.tls_min_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.verify_ssl = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican.verify_ssl_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.auth_section = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.auth_type = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.collect_timing = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.tls_ciphers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] barbican_service_user.tls_min_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.approle_role_id = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.approle_secret_id = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.auth_method = approle {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.auth_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.kv_mountpoint = secret {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.kv_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.kv_version = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.namespace = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.root_token_id = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.ssl_ca_crt_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.timeout = 60.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.token_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.token_role = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.use_ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:29 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] ******************************************************************************** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 20:03:29 devstack cinder-volume[77314]: WARNING amqp [None req-6e2a834f-ff2c-4e1f-a6d5-8d991597273f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 20:03:29 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.454s {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:29 devstack cinder-volume[87581]: INFO cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 succeeded Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=87581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.467s {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:29 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:03:29 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:29 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.276s {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:29 devstack cinder-volume[87581]: INFO cinder.volume.driver [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 20:03:29 devstack cinder-volume[87581]: DEBUG cinder.volume.driver [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1409454345703, 'free_capacity_gb': 1773.1409454345703, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87581) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_db.sqlalchemy.engines [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG dbcounter [-] [87581] Writer thread running {{(pid=87581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG cinder.db.api [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Building query based on filter {{(pid=87581) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG cinder.image.image_utils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87581) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 20:03:30 devstack cinder-volume[87581]: INFO cinder.keymgr.migration [None req-b44418c3-927e-4bcc-883c-b21d4dc1304d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=87581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=87581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:30 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:03:30 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:30 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.274s {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG cinder.manager [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Notifying Schedulers of capabilities ... {{(pid=87581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:30 devstack cinder-volume[87581]: INFO cinder.volume.manager [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Driver initialization completed successfully. Sep 10 20:03:30 devstack cinder-volume[87581]: INFO cinder.manager [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Initiating service 3 cleanup Sep 10 20:03:30 devstack cinder-volume[87581]: INFO cinder.manager [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Service 3 cleanup completed. Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG cinder.service [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Creating RPC server for service cinder-volume {{(pid=87581) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG cinder.service [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87581) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 20:03:30 devstack cinder-volume[87581]: INFO cinder.volume.manager [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=87581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.quobyte [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=87581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:30 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:03:30 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:30 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:30 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.345s {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:30 devstack cinder-volume[87581]: INFO cinder.volume.manager [None req-96898c27-008c-4ed3-a241-ae2acefb7421 None None] Driver post RPC initialization completed successfully. Sep 10 20:03:36 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-15b57b77-1a36-4774-aa00-c241c0f8b7d4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:36 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-15b57b77-1a36-4774-aa00-c241c0f8b7d4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:36 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.quobyte [None req-15b57b77-1a36-4774-aa00-c241c0f8b7d4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=87581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:03:36 devstack cinder-volume[87581]: DEBUG cinder.volume.drivers.quobyte [None req-15b57b77-1a36-4774-aa00-c241c0f8b7d4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=87581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:03:36 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-15b57b77-1a36-4774-aa00-c241c0f8b7d4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:36 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-15b57b77-1a36-4774-aa00-c241c0f8b7d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:36 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:03:36 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:36 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:36 devstack cinder-volume[87581]: DEBUG oslo_concurrency.processutils [None req-15b57b77-1a36-4774-aa00-c241c0f8b7d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.293s {{(pid=87581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:36 devstack cinder-volume[87581]: DEBUG cinder.manager [None req-15b57b77-1a36-4774-aa00-c241c0f8b7d4 None None] Notifying Schedulers of capabilities ... {{(pid=87581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:37 devstack cinder-volume[87363]: INFO oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Caught SIGTERM, stopping children Sep 10 20:03:37 devstack cinder-volume[87363]: DEBUG oslo_concurrency.lockutils [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Acquiring lock "singleton_lock" {{(pid=87363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 20:03:37 devstack cinder-volume[87363]: DEBUG oslo_concurrency.lockutils [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Acquired lock "singleton_lock" {{(pid=87363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 20:03:37 devstack cinder-volume[87363]: DEBUG oslo_concurrency.lockutils [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Releasing lock "singleton_lock" {{(pid=87363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 20:03:37 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Stop services. {{(pid=87363) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 10 20:03:37 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Killing children. {{(pid=87363) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 10 20:03:37 devstack cinder-volume[87363]: INFO oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Waiting on 1 children to exit Sep 10 20:03:38 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Acquiring lock "singleton_lock" {{(pid=87581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 20:03:38 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Acquired lock "singleton_lock" {{(pid=87581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 20:03:38 devstack cinder-volume[87581]: DEBUG oslo_concurrency.lockutils [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Releasing lock "singleton_lock" {{(pid=87581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 20:03:38 devstack cinder-volume[87581]: WARNING amqp [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 20:03:38 devstack cinder-volume[87581]: WARNING amqp [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 20:03:38 devstack cinder-volume[87363]: INFO oslo_service.backend._eventlet.service [None req-3d96ddce-b850-4025-8e52-58e7a95fdfc7 None None] Child 87581 exited with status 0 Sep 10 20:03:39 devstack cinder-volume[87871]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 20:03:39 devstack cinder-volume[87871]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 20:03:39 devstack cinder-volume[87871]: we strongly recommend against using it for new projects. Sep 10 20:03:39 devstack cinder-volume[87871]: If you are already using Eventlet, we recommend migrating to a different Sep 10 20:03:39 devstack cinder-volume[87871]: framework. For more detail see Sep 10 20:03:39 devstack cinder-volume[87871]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 20:03:39 devstack cinder-volume[87871]: import eventlet # noqa Sep 10 20:03:42 devstack cinder-volume[87871]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 20:03:42 devstack cinder-volume[87871]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 20:03:42 devstack cinder-volume[87871]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87871) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 20:03:43 devstack cinder-volume[87871]: INFO dbcounter [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Registered counter for database cinder Sep 10 20:03:43 devstack cinder-volume[87871]: DEBUG oslo_db.sqlalchemy.engines [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG dbcounter [-] [87871] Writer thread running {{(pid=87871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 20:03:44 devstack cinder-volume[87871]: INFO cinder.rpc [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 20:03:44 devstack cinder-volume[87871]: INFO cinder.rpc [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_db.sqlalchemy.engines [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 20:03:44 devstack cinder-volume[87871]: INFO cinder.volume.manager [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Determined volume DB was empty at startup. Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG cinder.volume.manager [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87871) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 20:03:44 devstack cinder-volume[87871]: WARNING stevedore.named [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 20:03:44 devstack cinder-volume[87871]: WARNING castellan.key_manager [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 20:03:44 devstack cinder-volume[87871]: WARNING cinder.keymgr.conf_key_mgr [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 20:03:44 devstack cinder-volume[87871]: INFO cinder.volume.manager [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_db.sqlalchemy.engines [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87871) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 20:03:44 devstack cinder-volume[87871]: INFO oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Starting 1 workers Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Started child 88137 {{(pid=87871) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Full set of CONF: {{(pid=87871) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] ******************************************************************************** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] Configuration options gathered from: {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] ================================================================================ {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] allow_availability_zone_fallback = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] allow_compression_on_image_upload = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] allowed_direct_url_schemes = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] api_rate_limit = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] auth_strategy = keystone {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_availability_zone = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_host = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_stats_polling_interval = 60 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backup_api_class = cinder.backup.api.API {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backup_name_template = backup-%s {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backup_use_same_host = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backup_use_temp_snapshot = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] chap_password = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] chap_username = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[88137]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cinder_internal_tenant_project_id = 29b6cb7abac94e0fb8c42a266660e316 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cinder_internal_tenant_user_id = 79997a13f3ff4405be60e74e56edcce0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cluster = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] compression_format = gzip {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] compute_api_class = cinder.compute.nova.API {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] config_dir = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] config_source = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] control_exchange = openstack {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] debug = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] default_availability_zone = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] default_group_type = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] default_volume_type = QuobyteHD {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] disk_geometry = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] driver_client_cert = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] driver_client_cert_key = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] driver_data_namespace = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] driver_ssl_cert_path = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] driver_ssl_cert_verify = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] driver_use_ssl = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] enable_new_services = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] enable_unsupported_driver = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] enabled_backends = ['QuobyteHD'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] enforce_multipath_for_image_xfer = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] filter_function = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_api_insecure = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_api_servers = ['http://192.168.122.91/image'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_api_ssl_compression = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_ca_certificates_file = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_catalog_info = image:glance:publicURL {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_certfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_keyfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_num_retries = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance_request_timeout = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] goodness_function = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Starting volume driver QuobyteDriver (1.2) Sep 10 20:03:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88137) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] graceful_shutdown_timeout = 5 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] group_api_class = cinder.group.api.API {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] host = devstack {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_compress_on_upload = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_conversion_address_space_limit = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_conversion_cpu_limit = 60 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_conversion_disable = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_upload_use_cinder_backend = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_upload_use_internal_tenant = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_volume_cache_enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_volume_cache_max_count = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] image_volume_cache_max_size_gb = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] init_host_max_objects_retrieval = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] instance_format = [instance: %(uuid)s] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] iscsi_target_flags = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] iscsi_write_cache = on {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] iser_helper = tgtadm {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] iser_ip_address = 192.168.122.91 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] iser_port = 3260 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] log_color = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] log_config_append = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] log_dir = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] log_file = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] log_options = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] log_rotate_interval = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] log_rotate_interval_type = days {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] log_rotation_type = none {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] max_age = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] max_logfile_count = 30 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] max_logfile_size_mb = 200 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] max_over_subscription_ratio = 20.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] message_reap_interval = 86400 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] message_ttl = 2592000 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] migration_create_volume_timeout_secs = 300 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] monkey_patch = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] monkey_patch_modules = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] my_ip = 192.168.122.91 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] no_snapshot_gb_quota = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] num_iser_scan_tries = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] num_shell_tries = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] num_volume_device_scan_tries = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] nvmeof_conn_info_version = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] nvmet_ns_id = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] nvmet_port_id = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] osapi_max_limit = 1000 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] osapi_volume_ext_list = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] osapi_volume_listen_port = 8776 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] osapi_volume_use_ssl = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] osapi_volume_workers = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] per_volume_size_limit = -1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] periodic_fuzzy_delay = 60 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] periodic_interval = 60 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] public_endpoint = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] publish_errors = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] quota_backup_gigabytes = 1000 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] quota_backups = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] quota_gigabytes = 1000 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] quota_groups = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] quota_snapshots = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] quota_volumes = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] rate_limit_burst = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] rate_limit_except_level = CRITICAL {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] rate_limit_interval = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] reinit_driver_count = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] replication_device = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88137) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 10 20:03:44 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.quobyte [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 10 20:03:44 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.quobyte [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] report_discard_supported = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Running cmd (subprocess): mount.quobyte {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] report_interval = 120 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] reservation_clean_interval = 86400 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] reservation_expire = 86400 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] reserved_image_namespaces = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] reserved_percentage = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] rpc_response_timeout = 120 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] run_external_periodic_tasks = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] scst_target_driver = iscsi {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] scst_target_iqn_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_down_time = 720 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] shell_completion = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] snapshot_name_template = snapshot-%s {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] split_loggers = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] state_path = /opt/stack/data/cinder {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] storage_availability_zone = nova {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] storage_protocol = iSCSI {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] syslog_log_facility = LOG_USER {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] target_helper = lioadm {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] target_ip_address = 192.168.122.91 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] target_port = 3260 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] target_protocol = iscsi {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] target_secondary_ip_addresses = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] trace_flags = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] transport_url = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] until_refresh = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] use_chap_auth = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] use_default_quota_class = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] use_journal = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] use_json = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] use_multipath_for_image_xfer = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] use_stderr = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] use_syslog = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] verify_glance_signatures = enabled {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_api_class = cinder.volume.api.API {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_backend_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_clear = zero {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_clear_ionice = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_clear_size = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_copy_bps_limit = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_dd_blocksize = 1M {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_name_template = volume-%s {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_service_inithost_offload = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volume_usage_audit_period = month {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] zoning_mode = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_concurrency.disable_process_locking = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.auth_section = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:44 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.auth_type = password {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.auth_version = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.cache = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.certfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.include_service_catalog = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.insecure = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.interface = public {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.keyfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_password = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack quobyte-client[88138]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack quobyte-client[88138]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcache_username = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.region_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.service_type = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.backend = dogpile.cache.null {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.backend_argument = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:03:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.backend_expiration_time = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.config_prefix = cache.oslo {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.debug_cache_backend = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.enable_retry_client = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.enable_socket_keepalive = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.expiration_time = 600 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.hashclient_retry_attempts = 2 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.memcache_dead_retry = 300 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.memcache_pool_maxsize = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.memcache_sasl_enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.password = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.proxies = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.redis_db = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.redis_server = localhost:6379 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.retry_attempts = 2 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.retry_delay = 0.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.socket_keepalive_count = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.socket_keepalive_idle = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.socket_keepalive_interval = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.socket_timeout = 1.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.tls_allowed_ciphers = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.tls_cafile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.tls_certfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.tls_enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.tls_keyfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cache.username = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] coordination.backend_url = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.asyncio_connection = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.asyncio_slave_connection = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.backend = sqlalchemy {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.connection = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.connection_debug = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.connection_parameters = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.connection_recycle_time = 3600 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.connection_trace = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.db_inc_retry_interval = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.db_max_retries = 20 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:03:45 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.db_max_retry_interval = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.db_retry_interval = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.max_overflow = 50 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.max_pool_size = 5 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.max_retries = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.mysql_wsrep_sync_wait = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.pool_timeout = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.retry_interval = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.slave_connection = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.sqlite_synchronous = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.synchronous_reader = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] database.use_db_reconnect = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_tracing.insecure = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.connection_string = messaging:// {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.es_doc_type = notification {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.es_scroll_size = 10000 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.es_scroll_time = 2m {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.filter_error_trace = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.hmac_keys = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.sentinel_service_name = mymaster {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.socket_timeout = 0.1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.trace_requests = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler.trace_sqlalchemy = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler_jaeger.process_tags = {} {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler_jaeger.service_name_prefix = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] profiler_otlp.service_name_prefix = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.enforce_new_defaults = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.policy_default_rule = default {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.policy_file = policy.yaml {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] privsep_osbrick.group = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] privsep_osbrick.helper_command = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] privsep_osbrick.user = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cinder_sys_admin.group = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cinder_sys_admin.helper_command = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] cinder_sys_admin.user = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.auth_section = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.auth_type = password {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.cafile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.certfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.collect_timing = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.insecure = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.keyfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.send_service_user_token = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.split_loggers = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.timeout = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.tls_ciphers = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] service_user.tls_min_version = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.auth_section = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.auth_type = password {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.certfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.collect_timing = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.insecure = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.keyfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.region_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.split_loggers = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.timeout = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.tls_ciphers = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] glance.tls_min_version = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.backend_availability_zone = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.chap_password = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.chap_username = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.disk_geometry = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.driver_client_cert = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.driver_client_cert_key = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.driver_data_namespace = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.driver_use_ssl = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.extra_capabilities = {} {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.filter_function = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.goodness_function = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.iscsi_target_flags = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.iscsi_write_cache = on {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.iser_helper = tgtadm {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.iser_port = 3260 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_host = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_login = admin {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_mount_options = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_password = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_private_key = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_share_path = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.num_shell_tries = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.quobyte_volume_url = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.replication_device = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.report_discard_supported = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.reserved_percentage = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.target_helper = tgtadm {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.target_port = 3260 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.target_protocol = iscsi {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.trace_flags = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.unique_fqdn_network = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.use_chap_auth = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.volume_backend_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.volume_clear = zero {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.volume_clear_ionice = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.volume_clear_size = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_reports.file_event_handler = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_reports.log_dir = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.backend_availability_zone = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.backend_host = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.chap_password = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.chap_username = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.chiscsi_conf = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.disk_geometry = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.driver_client_cert = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.driver_data_namespace = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.driver_use_ssl = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.extra_capabilities = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.filter_function = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.goodness_function = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.iser_helper = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.iser_ip_address = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.iser_port = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.iser_target_prefix = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_host = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_login = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_mount_options = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_password = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_private_key = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_share_path = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_ssh_port = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.num_shell_tries = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.nvmet_port_id = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.replication_device = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.report_discard_supported = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.reserved_percentage = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.scst_target_driver = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.storage_protocol = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.target_helper = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.target_ip_address = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.target_port = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.target_prefix = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.target_protocol = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.trace_flags = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.use_chap_auth = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.volume_clear = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.volume_clear_size = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] QuobyteHD.volumes_dir = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.ssl = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_notifications.driver = [] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_notifications.retry = -1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] key_manager.fixed_key = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.barbican_api_version = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.barbican_endpoint = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.barbican_endpoint_type = public {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.barbican_region_name = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.cafile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.certfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.collect_timing = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.insecure = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.keyfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.number_of_retries = 60 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.retry_delay = 1 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.send_service_user_token = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.split_loggers = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.timeout = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.tls_ciphers = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.tls_min_version = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.verify_ssl = True {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican.verify_ssl_path = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.auth_section = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.auth_type = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.cafile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.certfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.collect_timing = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.insecure = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.keyfile = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.split_loggers = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.timeout = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.tls_ciphers = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] barbican_service_user.tls_min_version = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.approle_role_id = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.approle_secret_id = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.auth_method = approle {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.auth_path = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.kv_mountpoint = secret {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.kv_path = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.kv_version = 2 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.namespace = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.root_token_id = **** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.ssl_ca_crt_file = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.timeout = 60.0 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.token_file = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.token_role = None {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.use_ssl = False {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 20:03:45 devstack cinder-volume[87871]: DEBUG oslo_service.backend._eventlet.service [None req-00e70f2d-661d-4466-93bc-9f0febff1057 None None] ******************************************************************************** {{(pid=87871) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 20:03:45 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.809s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:45 devstack cinder-volume[88137]: INFO cinder.volume.driver [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 20:03:45 devstack cinder-volume[88137]: DEBUG cinder.volume.driver [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1409454345703, 'free_capacity_gb': 1773.1409454345703, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88137) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_db.sqlalchemy.engines [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writer thread running {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG cinder.db.api [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Building query based on filter {{(pid=88137) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88137) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:46 devstack cinder-volume[88137]: INFO cinder.keymgr.migration [None req-d1de7321-6a88-4dc2-b92d-fa5587e00e17 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 20:03:46 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:03:46 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:46 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.448s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:03:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Driver initialization completed successfully. Sep 10 20:03:46 devstack cinder-volume[88137]: INFO cinder.manager [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Initiating service 3 cleanup Sep 10 20:03:46 devstack cinder-volume[88137]: INFO cinder.manager [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Service 3 cleanup completed. Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG cinder.service [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Creating RPC server for service cinder-volume {{(pid=88137) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG cinder.service [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88137) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 20:03:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:03:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:03:47 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:03:47 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:03:47 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Sep 10 20:03:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.429s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:03:47 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-44a03df3-af88-4c95-984f-0db6f0c95e42 None None] Driver post RPC initialization completed successfully. Sep 10 20:03:54 devstack cinder-volume[87871]: DEBUG dbcounter [-] [87871] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87871) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:03:56 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:03:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:04:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:04:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 6 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:04:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Flow 'volume_create_manager' (b0a5790a-22a2-4507-85ff-1f6952a334ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b842145-b7cb-4fbf-9a4c-3e673a8b7b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b842145-b7cb-4fbf-9a4c-3e673a8b7b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1347872745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5916284-216f-4887-bac0-74b1904273d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b529732b900649ed93a2b484c8e806a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:49Z,use_quota=True,user_id='c7afe0d55a7b46569ebaee064b8616c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5febfaa-9750-4ed4-8262-c4c7a34f88f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5febfaa-9750-4ed4-8262-c4c7a34f88f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63a7eec-cf0c-4325-bd92-7c5ac3a231fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63a7eec-cf0c-4325-bd92-7c5ac3a231fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5916284-216f-4887-bac0-74b1904273d6', 'volume_name': 'volume-c5916284-216f-4887-bac0-74b1904273d6', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e1122e-2971-4588-8889-5e128cf2cf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e1122e-2971-4588-8889-5e128cf2cf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a3bc99-57ba-4f79-b0e1-d6e757950d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:48 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Volume c5916284-216f-4887-bac0-74b1904273d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5916284-216f-4887-bac0-74b1904273d6', 'volume_size': 1} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1347872745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5916284-216f-4887-bac0-74b1904273d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b529732b900649ed93a2b484c8e806a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:04:49Z,use_quota=True,user_id='c7afe0d55a7b46569ebaee064b8616c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Creating volume c5916284-216f-4887-bac0-74b1904273d6 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:04:48 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:04:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:48 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6 1073741824 Sep 10 20:04:48 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:49 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6 1073741824" returned: 0 in 0.667s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:04:49 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6 Sep 10 20:04:49 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:04:50 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Sep 10 20:04:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6" returned: 0 in 0.512s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:04:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:04:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:04:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a3bc99-57ba-4f79-b0e1-d6e757950d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5916284-216f-4887-bac0-74b1904273d6', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce84415-49f0-44ce-a8fd-94464b0b81cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:04:50 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Volume volume-c5916284-216f-4887-bac0-74b1904273d6 (c5916284-216f-4887-bac0-74b1904273d6): created successfully Sep 10 20:04:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce84415-49f0-44ce-a8fd-94464b0b81cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:04:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Flow 'volume_create_manager' (b0a5790a-22a2-4507-85ff-1f6952a334ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:04:50 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8088a386-2dbb-4a64-9986-86f5947f83a8 tempest-TaggedAttachmentsTest-1745676197 None] Created volume successfully. Sep 10 20:05:00 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:05:00 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Flow 'volume_create_manager' (4ced4b47-15a4-4bbe-9b77-60f83f952588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a1c35c-31ff-4051-8ea6-8f9ab4da201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a1c35c-31ff-4051-8ea6-8f9ab4da201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-815051187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c23391f404f46a2ba2eb6f5c3a44d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:17Z,use_quota=True,user_id='31ca4a4d1ee54d648264d2a56ec9173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c5053a-a390-4c7f-a0ce-decaee98370c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c5053a-a390-4c7f-a0ce-decaee98370c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa94d4b2-d63e-4a3b-b227-60eff1f0c0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa94d4b2-d63e-4a3b-b227-60eff1f0c0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102', 'volume_name': 'volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd02390-7377-4913-9afc-1193202f07b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd02390-7377-4913-9afc-1193202f07b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff93eac-e56c-41f5-80b0-620dd56ec03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:17 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Volume fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102', 'volume_size': 1} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-815051187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c23391f404f46a2ba2eb6f5c3a44d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:17Z,use_quota=True,user_id='31ca4a4d1ee54d648264d2a56ec9173f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Creating volume fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:05:17 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:05:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:17 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 1073741824 Sep 10 20:05:17 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:18 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 1073741824" returned: 0 in 1.197s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:18 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 Sep 10 20:05:18 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:19 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102" returned: 0 in 0.574s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff93eac-e56c-41f5-80b0-620dd56ec03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19dc482-ecb1-4a9f-b98a-5ba34fcc1e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Volume volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 (fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102): created successfully Sep 10 20:05:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19dc482-ecb1-4a9f-b98a-5ba34fcc1e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Flow 'volume_create_manager' (4ced4b47-15a4-4bbe-9b77-60f83f952588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a17a6919-ae42-4ac1-8f71-bae25565b43c tempest-DeleteServersTestJSON-1400907651 None] Created volume successfully. Sep 10 20:05:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:05:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:20 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:05:20 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:21 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.749s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:21 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:21 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:05:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 6 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:05:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Flow 'volume_create_manager' (1aecb143-e277-42b1-800d-ce8c25eb5251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484ed4bf-262e-48c1-8c0e-b8c26399978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484ed4bf-262e-48c1-8c0e-b8c26399978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-560928711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035d61df-b22e-4cc2-a387-1283cb9f2be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c3abb47aa14818a4177fa8e6fe4120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:25Z,use_quota=True,user_id='d526eface19846588d301651849686ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b810e086-9811-4b05-9489-6a52e0c49d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b810e086-9811-4b05-9489-6a52e0c49d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a283b00f-c4b2-4e77-ac4b-1c681f3c06a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a283b00f-c4b2-4e77-ac4b-1c681f3c06a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035d61df-b22e-4cc2-a387-1283cb9f2be9', 'volume_name': 'volume-035d61df-b22e-4cc2-a387-1283cb9f2be9', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26791b4-181a-43fd-862b-c70ae9e89c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26791b4-181a-43fd-862b-c70ae9e89c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3969bd-c7d6-4477-a9e9-7346302d1d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:25 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Volume 035d61df-b22e-4cc2-a387-1283cb9f2be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035d61df-b22e-4cc2-a387-1283cb9f2be9', 'volume_size': 1} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-560928711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035d61df-b22e-4cc2-a387-1283cb9f2be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c3abb47aa14818a4177fa8e6fe4120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:25Z,use_quota=True,user_id='d526eface19846588d301651849686ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Creating volume 035d61df-b22e-4cc2-a387-1283cb9f2be9 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:05:25 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:05:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:25 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 1073741824 Sep 10 20:05:25 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:27 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 1073741824" returned: 0 in 1.595s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:27 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 Sep 10 20:05:27 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:27 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9" returned: 0 in 0.520s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3969bd-c7d6-4477-a9e9-7346302d1d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035d61df-b22e-4cc2-a387-1283cb9f2be9', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0ade53-d86a-43aa-8671-bcbd063ba241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Volume volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 (035d61df-b22e-4cc2-a387-1283cb9f2be9): created successfully Sep 10 20:05:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0ade53-d86a-43aa-8671-bcbd063ba241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Flow 'volume_create_manager' (1aecb143-e277-42b1-800d-ce8c25eb5251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6bd96a98-467a-4f6c-9742-0e999b1c1f3b tempest-VolumesAdminNegativeTest-1812440250 None] Created volume successfully. Sep 10 20:05:29 devstack cinder-volume[88137]: WARNING py.warnings [req-f88c9fcc-74c1-49b1-891b-c68a5dc047a6 req-cd80724b-89c7-4480-a09d-bd9200b3127f tempest-DeleteServersTestJSON-1400907651 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 10 20:05:29 devstack cinder-volume[88137]: .first() Sep 10 20:05:29 devstack cinder-volume[88137]: Sep 10 20:05:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Acquiring lock "cinder-035d61df-b22e-4cc2-a387-1283cb9f2be9-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Lock "cinder-035d61df-b22e-4cc2-a387-1283cb9f2be9-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-f88c9fcc-74c1-49b1-891b-c68a5dc047a6 req-cd80724b-89c7-4480-a09d-bd9200b3127f tempest-DeleteServersTestJSON-1400907651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-f88c9fcc-74c1-49b1-891b-c68a5dc047a6 req-cd80724b-89c7-4480-a09d-bd9200b3127f tempest-DeleteServersTestJSON-1400907651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-f88c9fcc-74c1-49b1-891b-c68a5dc047a6 req-cd80724b-89c7-4480-a09d-bd9200b3127f tempest-DeleteServersTestJSON-1400907651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-f88c9fcc-74c1-49b1-891b-c68a5dc047a6 req-cd80724b-89c7-4480-a09d-bd9200b3127f tempest-DeleteServersTestJSON-1400907651 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ef1e3c5-8ef5-4d98-9d47-76b58ff93ac7', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:05:30 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Acquiring lock "cinder-quobyte-035d61df-b22e-4cc2-a387-1283cb9f2be9" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:30 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Lock "cinder-quobyte-035d61df-b22e-4cc2-a387-1283cb9f2be9" acquired by "delete_volume" :: waited 0.087s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:30 devstack cinder-volume[88137]: INFO oslo.privsep.daemon [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgx2o55rv/privsep.sock'] Sep 10 20:05:30 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgx2o55rv/privsep.sock Sep 10 20:05:30 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-f88c9fcc-74c1-49b1-891b-c68a5dc047a6 req-cd80724b-89c7-4480-a09d-bd9200b3127f tempest-DeleteServersTestJSON-1400907651 None] attachment_update completed successfully. Sep 10 20:05:33 devstack cinder-volume[88137]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 10 20:05:33 devstack cinder-volume[88137]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 20:05:33 devstack cinder-volume[88137]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 10 20:05:33 devstack cinder-volume[88137]: WARNING oslo.privsep.daemon [-] privsep log: Sep 10 20:05:33 devstack cinder-volume[88137]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 10 20:05:33 devstack cinder-volume[88137]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 10 20:05:33 devstack cinder-volume[88137]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 20:05:33 devstack cinder-volume[88137]: WARNING oslo.privsep.daemon [-] privsep log: Sep 10 20:05:33 devstack cinder-volume[88137]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 10 20:05:33 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:33 devstack cinder-volume[88137]: INFO oslo.privsep.daemon [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Spawned new privsep daemon via rootwrap Sep 10 20:05:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Accepted privsep connection to /tmp/tmpgx2o55rv/privsep.sock {{(pid=88137) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 10 20:05:33 devstack cinder-volume[88137]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 10 20:05:33 devstack cinder-volume[88137]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 10 20:05:33 devstack cinder-volume[88137]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 10 20:05:33 devstack cinder-volume[88137]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89779 Sep 10 20:05:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[345c4e2e-13e4-4e71-9549-14e5e49b3658]: (2,) {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cebe4d6-8ec5-4880-a9eb-cb1b7a72fdc6]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:34 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 Sep 10 20:05:34 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:34 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9" returned: 0 in 1.039s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:34 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9 Sep 10 20:05:34 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:36 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-035d61df-b22e-4cc2-a387-1283cb9f2be9" returned: 0 in 1.221s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Lock "cinder-quobyte-035d61df-b22e-4cc2-a387-1283cb9f2be9" released by "delete_volume" :: held 5.441s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:36 devstack cinder-volume[88137]: WARNING cinder.quota [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:05:36 devstack cinder-volume[88137]: WARNING cinder.quota [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Created reservations ['848ee82e-df34-45e2-af7d-8bdcff83c37f', 'dcbeeeff-3506-4c59-8701-387e94fa435e', 'eb4ee41b-90ef-471f-82a5-241d2ce95df4', '26162a58-9c4c-434f-9dd8-7535e27c3c7b'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:36 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:05:36 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:36 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.421s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:36 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Deleted volume successfully. Sep 10 20:05:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e8386346-3c00-4d33-a058-4ce2ec5fa35f tempest-VolumesAdminNegativeTest-1812440250 None] Lock "cinder-035d61df-b22e-4cc2-a387-1283cb9f2be9-delete_volume" released by "delete_volume" :: held 7.150s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-74a313a5-55e8-4217-a4ac-ad832d14629d req-680dd593-53e6-4b92-b68b-2b7368bcafdf tempest-DeleteServersTestJSON-1400907651 None] Terminate volume connection completed successfully. Sep 10 20:05:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-74a313a5-55e8-4217-a4ac-ad832d14629d req-680dd593-53e6-4b92-b68b-2b7368bcafdf tempest-DeleteServersTestJSON-1400907651 None] Deleting attachment 2ef1e3c5-8ef5-4d98-9d47-76b58ff93ac7. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:05:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Acquiring lock "cinder-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Lock "cinder-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Acquiring lock "cinder-quobyte-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Lock "cinder-quobyte-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:42 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[204d7276-10f7-4a28-b3d7-14937a7d1703]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:42 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 Sep 10 20:05:42 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:42 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102" returned: 0 in 0.567s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:42 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102 Sep 10 20:05:42 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:43 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102" returned: 0 in 0.313s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Lock "cinder-quobyte-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102" released by "delete_volume" :: held 0.961s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Created reservations ['58d7fcdd-1018-4b61-9090-9bae4bf14856', 'beb5016b-a778-4af7-91dd-7f36eef67894', '984aa4f9-0278-4567-9098-19cbb9caa341', 'd9422963-a889-4861-829d-4e29859ef8f3'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:43 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:05:43 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:43 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.441s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:43 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Deleted volume successfully. Sep 10 20:05:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2164fe22-7c63-4057-8a14-630b6fdad2f9 tempest-DeleteServersTestJSON-1400907651 None] Lock "cinder-fc7c7b98-1e4b-4510-b8ad-1e8c06bcd102-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Flow 'volume_create_manager' (cab85cfa-b682-4708-9897-8d9c49a579b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6532687c-a2da-4fd9-8f4c-fc8802b5df5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6532687c-a2da-4fd9-8f4c-fc8802b5df5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-599363195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a9582b-ca90-4a49-abb4-d0988353110c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ac7e6198fcb46c8ae85c863611cd666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:48Z,use_quota=True,user_id='3e1605cca1b24cd4b815c006af7098dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bfa3de-cb14-47aa-8f0d-925c4147b5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bfa3de-cb14-47aa-8f0d-925c4147b5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e86310-db54-4c83-8438-d21b16d28954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e86310-db54-4c83-8438-d21b16d28954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a9582b-ca90-4a49-abb4-d0988353110c', 'volume_name': 'volume-80a9582b-ca90-4a49-abb4-d0988353110c', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a87cf7-400f-4caa-930b-f4523b2b8100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a87cf7-400f-4caa-930b-f4523b2b8100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c674266c-5ebb-4cd1-9e7b-5013a8de3e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:47 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Volume 80a9582b-ca90-4a49-abb4-d0988353110c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a9582b-ca90-4a49-abb4-d0988353110c', 'volume_size': 1} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-599363195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a9582b-ca90-4a49-abb4-d0988353110c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ac7e6198fcb46c8ae85c863611cd666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:48Z,use_quota=True,user_id='3e1605cca1b24cd4b815c006af7098dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Creating volume 80a9582b-ca90-4a49-abb4-d0988353110c {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:05:47 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:05:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:47 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c 1073741824 Sep 10 20:05:47 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:48 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c 1073741824" returned: 0 in 0.551s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:48 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c Sep 10 20:05:48 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:48 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c" returned: 0 in 0.274s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c674266c-5ebb-4cd1-9e7b-5013a8de3e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a9582b-ca90-4a49-abb4-d0988353110c', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61701245-4a98-4e33-be27-574a6662153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:48 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Volume volume-80a9582b-ca90-4a49-abb4-d0988353110c (80a9582b-ca90-4a49-abb4-d0988353110c): created successfully Sep 10 20:05:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61701245-4a98-4e33-be27-574a6662153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Flow 'volume_create_manager' (cab85cfa-b682-4708-9897-8d9c49a579b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d932d8e5-7e0d-4895-b9b1-b10839e0436c tempest-VolumesTestJSON-755091262 None] Created volume successfully. Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Flow 'volume_create_manager' (c252e074-4a56-4e22-986e-2c0afd3cf2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ae4ff6-d9e1-444c-b5ec-f9b5db9f31ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ae4ff6-d9e1-444c-b5ec-f9b5db9f31ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-23672283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024eedb7-0e5d-438b-99c4-4ad9b2fe38f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ac7e6198fcb46c8ae85c863611cd666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:51Z,use_quota=True,user_id='3e1605cca1b24cd4b815c006af7098dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f58156-76bc-4a71-ae9d-03866dbdf3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f58156-76bc-4a71-ae9d-03866dbdf3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780203ca-4829-474e-803e-7aea2357075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780203ca-4829-474e-803e-7aea2357075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024eedb7-0e5d-438b-99c4-4ad9b2fe38f5', 'volume_name': 'volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5266ae0a-0947-401c-8fe5-37115519cb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5266ae0a-0947-401c-8fe5-37115519cb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca6c4de-d0ba-45ae-b5c0-4ca8bec73047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:50 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Volume 024eedb7-0e5d-438b-99c4-4ad9b2fe38f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5', 'volume_size': 1} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-23672283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024eedb7-0e5d-438b-99c4-4ad9b2fe38f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ac7e6198fcb46c8ae85c863611cd666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:51Z,use_quota=True,user_id='3e1605cca1b24cd4b815c006af7098dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Creating volume 024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:05:50 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:05:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:50 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 1073741824 Sep 10 20:05:50 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:51 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 1073741824" returned: 0 in 0.694s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:51 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 Sep 10 20:05:51 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:51 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5" returned: 0 in 0.324s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca6c4de-d0ba-45ae-b5c0-4ca8bec73047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ce46be-c8e2-47f5-a3a6-7ada41e2c371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Volume volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 (024eedb7-0e5d-438b-99c4-4ad9b2fe38f5): created successfully Sep 10 20:05:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ce46be-c8e2-47f5-a3a6-7ada41e2c371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Flow 'volume_create_manager' (c252e074-4a56-4e22-986e-2c0afd3cf2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:52 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-bc5ae563-2fdd-40e3-9075-5e82b7129bbb tempest-VolumesTestJSON-755091262 None] Created volume successfully. Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Flow 'volume_create_manager' (92984e19-89eb-46fb-9b2a-bdc0f3b52f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87a04c7-bb99-4475-81f0-48ed75667a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87a04c7-bb99-4475-81f0-48ed75667a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-240631950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b996df-69e8-4ea9-90cf-163e2f50eb9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ac7e6198fcb46c8ae85c863611cd666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:54Z,use_quota=True,user_id='3e1605cca1b24cd4b815c006af7098dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a257ce-27d9-410a-9e1c-480148df675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a257ce-27d9-410a-9e1c-480148df675e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5676e20-d9ee-4565-b85b-3e28ca85c3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5676e20-d9ee-4565-b85b-3e28ca85c3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b996df-69e8-4ea9-90cf-163e2f50eb9d', 'volume_name': 'volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1fb165-7427-43b8-8c0f-e68d3cb00e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1fb165-7427-43b8-8c0f-e68d3cb00e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69bf082-ac55-4b69-a34f-132189f47571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:53 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Volume c2b996df-69e8-4ea9-90cf-163e2f50eb9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d', 'volume_size': 1} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-240631950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b996df-69e8-4ea9-90cf-163e2f50eb9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ac7e6198fcb46c8ae85c863611cd666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:05:54Z,use_quota=True,user_id='3e1605cca1b24cd4b815c006af7098dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Creating volume c2b996df-69e8-4ea9-90cf-163e2f50eb9d {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:05:53 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:05:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:53 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d 1073741824 Sep 10 20:05:53 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:54 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d 1073741824" returned: 0 in 0.607s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:54 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d Sep 10 20:05:54 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:54 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d" returned: 0 in 0.378s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:05:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69bf082-ac55-4b69-a34f-132189f47571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911e3d61-531a-456c-9099-a90c3043873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:05:54 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Volume volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d (c2b996df-69e8-4ea9-90cf-163e2f50eb9d): created successfully Sep 10 20:05:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911e3d61-531a-456c-9099-a90c3043873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:05:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Flow 'volume_create_manager' (92984e19-89eb-46fb-9b2a-bdc0f3b52f4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:05:54 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-412bf327-f210-4093-855e-6545ead47691 tempest-VolumesTestJSON-755091262 None] Created volume successfully. Sep 10 20:05:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Acquiring lock "cinder-c2b996df-69e8-4ea9-90cf-163e2f50eb9d-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Lock "cinder-c2b996df-69e8-4ea9-90cf-163e2f50eb9d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Acquiring lock "cinder-quobyte-c2b996df-69e8-4ea9-90cf-163e2f50eb9d" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Lock "cinder-quobyte-c2b996df-69e8-4ea9-90cf-163e2f50eb9d" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e99cf6d-d40d-4194-8ecd-9be2203d8284]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:57 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d Sep 10 20:05:57 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:57 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d" returned: 0 in 0.427s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:57 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d Sep 10 20:05:57 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:58 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c2b996df-69e8-4ea9-90cf-163e2f50eb9d" returned: 0 in 0.284s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Lock "cinder-quobyte-c2b996df-69e8-4ea9-90cf-163e2f50eb9d" released by "delete_volume" :: held 0.763s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Created reservations ['f78ba81e-114e-48aa-a768-e791d6b030aa', 'c848aa64-c296-4fd8-b5ad-0350edce2bae', '810665f2-f723-465f-a4e7-f552078318c7', '5e43e3d8-89c6-4487-925b-76a59c9fa135'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:58 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:05:58 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Acquiring lock "cinder-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Lock "cinder-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:58 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.286s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:05:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Deleted volume successfully. Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Acquiring lock "cinder-quobyte-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5d62f3d1-a0ab-4978-a3d0-fe6d02e0dc3a tempest-VolumesTestJSON-755091262 None] Lock "cinder-c2b996df-69e8-4ea9-90cf-163e2f50eb9d-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Lock "cinder-quobyte-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cda295-766b-434a-bcf0-0af37a5936f0]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:05:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:58 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 Sep 10 20:05:58 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:59 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5" returned: 0 in 0.497s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:59 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5 Sep 10 20:05:59 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:05:59 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5" returned: 0 in 0.481s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Lock "cinder-quobyte-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5" released by "delete_volume" :: held 1.042s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Created reservations ['bb147b62-f370-4f5d-8c16-063c00ca710b', '4a0c94a6-0cd0-4a75-870d-70b3b17db4ac', '4a6d2668-e199-4119-8abb-02d7eab0a7ef', 'fd5a094f-267f-4f1e-b5f5-b2aed123bc32'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:05:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:05:59 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:05:59 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:00 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.331s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:00 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:06:00 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Deleted volume successfully. Sep 10 20:06:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1a1ad6c9-6a98-4684-a26c-7cc7b8145827 tempest-VolumesTestJSON-755091262 None] Lock "cinder-024eedb7-0e5d-438b-99c4-4ad9b2fe38f5-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Acquiring lock "cinder-80a9582b-ca90-4a49-abb4-d0988353110c-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Lock "cinder-80a9582b-ca90-4a49-abb4-d0988353110c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Acquiring lock "cinder-quobyte-80a9582b-ca90-4a49-abb4-d0988353110c" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Lock "cinder-quobyte-80a9582b-ca90-4a49-abb4-d0988353110c" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:00 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95679a0-3388-4486-9aaa-51bfdd395415]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:06:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:01 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c Sep 10 20:06:01 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:01 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c" returned: 0 in 0.505s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:01 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c Sep 10 20:06:01 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:01 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-80a9582b-ca90-4a49-abb4-d0988353110c" returned: 0 in 0.417s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Lock "cinder-quobyte-80a9582b-ca90-4a49-abb4-d0988353110c" released by "delete_volume" :: held 0.979s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:01 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Created reservations ['dd7fe00b-cc62-40a3-84db-1d5402d33f14', '64a8a5e5-2490-40cd-86e4-fc1586ff9d37', 'd5dd80f5-c6d9-489a-b863-b3b9d9cbdc7f', '958e5e90-57f4-460e-b30d-4cb9a9b51e12'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:06:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:02 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:06:02 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:02 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.349s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:02 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:06:02 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Deleted volume successfully. Sep 10 20:06:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5e3ef576-9c2b-4253-9b31-329469ab2a5e tempest-VolumesTestJSON-755091262 None] Lock "cinder-80a9582b-ca90-4a49-abb4-d0988353110c-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:12 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=45,cinder:INSERT=14,cinder:UPDATE=62,cinder:DELETE=6 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:06:12 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=52,cinder:SELECT=41,cinder:INSERT=11,cinder:DELETE=4 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:06:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-f0c9b6d2-4e08-4914-bc58-967af552479e req-0fa9f13b-8f75-4e7c-9a77-13e6387761ec tempest-TaggedAttachmentsTest-1745676197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-f0c9b6d2-4e08-4914-bc58-967af552479e req-0fa9f13b-8f75-4e7c-9a77-13e6387761ec tempest-TaggedAttachmentsTest-1745676197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-f0c9b6d2-4e08-4914-bc58-967af552479e req-0fa9f13b-8f75-4e7c-9a77-13e6387761ec tempest-TaggedAttachmentsTest-1745676197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-f0c9b6d2-4e08-4914-bc58-967af552479e req-0fa9f13b-8f75-4e7c-9a77-13e6387761ec tempest-TaggedAttachmentsTest-1745676197 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-c5916284-216f-4887-bac0-74b1904273d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35d249db-941b-4f39-bd13-a27bfe66e0c8', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:06:13 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-f0c9b6d2-4e08-4914-bc58-967af552479e req-0fa9f13b-8f75-4e7c-9a77-13e6387761ec tempest-TaggedAttachmentsTest-1745676197 None] attachment_update completed successfully. Sep 10 20:06:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-33c30fa7-8bc8-4fca-be3f-fbed5200ea14 req-33d6d406-79a4-4108-ac01-ec90c6de4a05 tempest-TaggedAttachmentsTest-1745676197 None] Terminate volume connection completed successfully. Sep 10 20:06:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-33c30fa7-8bc8-4fca-be3f-fbed5200ea14 req-33d6d406-79a4-4108-ac01-ec90c6de4a05 tempest-TaggedAttachmentsTest-1745676197 None] Deleting attachment 35d249db-941b-4f39-bd13-a27bfe66e0c8. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:06:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-328d0701-141a-4b21-857b-753f77e2a905 tempest-GroupSnapshotsTest-423018851 None] Group tempest-GroupSnapshotsTest-Group-325081829: creating Sep 10 20:06:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-328d0701-141a-4b21-857b-753f77e2a905 tempest-GroupSnapshotsTest-423018851 None] Group tempest-GroupSnapshotsTest-Group-325081829: created successfully Sep 10 20:06:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-328d0701-141a-4b21-857b-753f77e2a905 tempest-GroupSnapshotsTest-423018851 None] Create group completed successfully. Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Flow 'volume_create_manager' (c499c6ce-f530-4426-b7df-d8011bf542b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73b65c9-35c4-4560-8fd0-53998bb72d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73b65c9-35c4-4560-8fd0-53998bb72d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1832278946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5587418c-defe-429c-88fc-f142afb7e5da,host='devstack@QuobyteHD#QuobyteHD',id=97206acc-774a-41f5-abc5-18c7bc75cfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c989e93e893474fb59d327961e20640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:06:20Z,use_quota=True,user_id='2acdcc1ea8ae44abb7ec29b3ad1cc157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b83f7cc1-1f7d-4427-8bb8-9e42dddd46af),volume_type_id=b83f7cc1-1f7d-4427-8bb8-9e42dddd46af)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06355770-1ed2-416a-8d35-01095d217077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06355770-1ed2-416a-8d35-01095d217077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cea9934-7f4f-4162-aa4c-3e3fc32f8df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cea9934-7f4f-4162-aa4c-3e3fc32f8df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97206acc-774a-41f5-abc5-18c7bc75cfad', 'volume_name': 'volume-97206acc-774a-41f5-abc5-18c7bc75cfad', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d243a5a2-0f08-4f19-a0b5-a8ded690556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d243a5a2-0f08-4f19-a0b5-a8ded690556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c8b0fc-78ce-412e-99b0-26ef2a60511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Volume 97206acc-774a-41f5-abc5-18c7bc75cfad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97206acc-774a-41f5-abc5-18c7bc75cfad', 'volume_size': 1} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5587418c-defe-429c-88fc-f142afb7e5da,created_at=2026-09-10T18:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1832278946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5587418c-defe-429c-88fc-f142afb7e5da,host='devstack@QuobyteHD#QuobyteHD',id=97206acc-774a-41f5-abc5-18c7bc75cfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c989e93e893474fb59d327961e20640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:06:20Z,use_quota=True,user_id='2acdcc1ea8ae44abb7ec29b3ad1cc157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b83f7cc1-1f7d-4427-8bb8-9e42dddd46af),volume_type_id=b83f7cc1-1f7d-4427-8bb8-9e42dddd46af)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Creating volume 97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:06:19 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:06:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:20 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad 1073741824 Sep 10 20:06:20 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:06:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:20 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:06:20 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:20 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad 1073741824" returned: 0 in 0.542s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:20 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad Sep 10 20:06:20 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:20 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.560s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 8 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:06:21 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad" returned: 0 in 0.540s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c8b0fc-78ce-412e-99b0-26ef2a60511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97206acc-774a-41f5-abc5-18c7bc75cfad', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22433383-fa84-4a6b-b6dc-2bba2c6ecd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:21 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Volume volume-97206acc-774a-41f5-abc5-18c7bc75cfad (97206acc-774a-41f5-abc5-18c7bc75cfad): created successfully Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22433383-fa84-4a6b-b6dc-2bba2c6ecd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Flow 'volume_create_manager' (c499c6ce-f530-4426-b7df-d8011bf542b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:06:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6f40cc2c-8980-4c2c-b4bc-a56740e56fe2 tempest-GroupSnapshotsTest-423018851 None] Created volume successfully. Sep 10 20:06:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] GroupSnapshot a732578a-8ddb-4b39-9659-764727cccdc2: creating. Sep 10 20:06:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Group snapshot a732578a-8ddb-4b39-9659-764727cccdc2: creating. {{(pid=88137) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 20:06:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Creating offline snapshot 8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d of volume 97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:06:23 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a60278f-0725-431e-935c-1f331c3e309d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:06:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:23 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad Sep 10 20:06:23 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:23 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad" returned: 0 in 0.468s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:23 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d 1G Sep 10 20:06:23 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:24 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d 1G" returned: 0 in 0.805s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97206acc-774a-41f5-abc5-18c7bc75cfad -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:24 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97206acc-774a-41f5-abc5-18c7bc75cfad -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d Sep 10 20:06:24 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:25 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97206acc-774a-41f5-abc5-18c7bc75cfad -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d" returned: 0 in 0.481s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:25 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:06:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:25 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d Sep 10 20:06:25 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:25 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d" returned: 0 in 0.313s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:25 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.info Sep 10 20:06:25 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:25 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.info" returned: 0 in 0.314s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:25 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:06:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:25 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.info Sep 10 20:06:25 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:26 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.info" returned: 0 in 0.330s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.855s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:26 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ac641e6b-a2e3-4e23-ad0a-3b7ab67b36cb tempest-GroupSnapshotsTest-423018851 None] group_snapshot a732578a-8ddb-4b39-9659-764727cccdc2: created successfully Sep 10 20:06:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d-2e5e6d7b-2392-437d-ba23-024b162a32b8" by "_create_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d-2e5e6d7b-2392-437d-ba23-024b162a32b8" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Creating volume 2e5e6d7b-2392-437d-ba23-024b162a32b8 from snapshot 8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d {{(pid=88137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-2e5e6d7b-2392-437d-ba23-024b162a32b8" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-2e5e6d7b-2392-437d-ba23-024b162a32b8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] snapshot: 8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d, volume: 2e5e6d7b-2392-437d-ba23-024b162a32b8, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5f9acf-177d-4049-93d8-63a5872df15e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:28 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d Sep 10 20:06:28 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:28 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d" returned: 0 in 0.768s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97206acc-774a-41f5-abc5-18c7bc75cfad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e541a0-8200-431f-9ffe-4e9eee9fe59f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:06:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:29 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad Sep 10 20:06:29 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:29 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad" returned: 0 in 0.584s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:06:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:06:29 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:06:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:29 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 Sep 10 20:06:29 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Acquiring lock "cinder-c5916284-216f-4887-bac0-74b1904273d6-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Lock "cinder-c5916284-216f-4887-bac0-74b1904273d6-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Acquiring lock "cinder-quobyte-c5916284-216f-4887-bac0-74b1904273d6" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Lock "cinder-quobyte-c5916284-216f-4887-bac0-74b1904273d6" acquired by "delete_volume" :: waited 0.051s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:35 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5865a3-fa19-4333-b6cb-4ae8b24055ce]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:06:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:35 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6 Sep 10 20:06:35 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:36 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6" returned: 0 in 0.997s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:36 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6 Sep 10 20:06:36 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:36 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c5916284-216f-4887-bac0-74b1904273d6" returned: 0 in 0.712s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Lock "cinder-quobyte-c5916284-216f-4887-bac0-74b1904273d6" released by "delete_volume" :: held 1.927s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Created reservations ['1a715165-434c-48e7-86ea-bb4a960ae7a8', 'ce5c402d-1673-4bac-a083-3ae9b18b0ddc', '4d863825-b9ac-49a6-b4b5-34074087f8d8', 'bf83020f-3c98-4be5-9b2e-5385a0401a0d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:37 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:06:37 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:37 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.432s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:06:37 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8" returned: 0 in 8.197s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Deleted volume successfully. Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:06:37 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Converted 1024.00 MB image at 124.81 MB/s Sep 10 20:06:37 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:37 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 Sep 10 20:06:37 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556089df-55c1-4c8a-9ade-48f22ed2e6c1 tempest-TaggedAttachmentsTest-1745676197 None] Lock "cinder-c5916284-216f-4887-bac0-74b1904273d6-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:38 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8" returned: 0 in 0.335s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-2e5e6d7b-2392-437d-ba23-024b162a32b8" released by "_copy_volume_from_snapshot" :: held 10.058s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d-2e5e6d7b-2392-437d-ba23-024b162a32b8" released by "_create_volume_from_snapshot" :: held 10.158s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.215s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f164e6c3-7118-4bdb-8398-4c5dddf18ba4 tempest-GroupSnapshotsTest-423018851 None] Create group from source-snapshot-a732578a-8ddb-4b39-9659-764727cccdc2 completed successfully. Sep 10 20:06:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-2e5e6d7b-2392-437d-ba23-024b162a32b8" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-2e5e6d7b-2392-437d-ba23-024b162a32b8" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18b6e48-082c-4c8a-bf6c-afc5176557d9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:06:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:40 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 Sep 10 20:06:40 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:40 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8" returned: 0 in 0.422s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:40 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8 Sep 10 20:06:40 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:40 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2e5e6d7b-2392-437d-ba23-024b162a32b8" returned: 0 in 0.278s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-2e5e6d7b-2392-437d-ba23-024b162a32b8" released by "delete_volume" :: held 0.759s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Created reservations ['60283fd3-ee17-487f-9f1a-4f4427b3f338'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:06:40 devstack cinder-volume[88137]: WARNING cinder.quota [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-118291834 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-118291834, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:06:40 devstack cinder-volume[88137]: WARNING cinder.quota [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-118291834 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-118291834, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Created reservations ['73385c47-c2cf-4051-8432-b958fe7dbeeb', '658b8eb2-5d6e-4ecd-9f3b-529be9998496', 'd1d20b1c-8e1a-4b31-86b1-b007346ccbde', '09c068f7-d94f-4110-aaf7-c747f00d8ded'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:40 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:06:40 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] group_snapshot a732578a-8ddb-4b39-9659-764727cccdc2: deleting Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] group_snapshot a732578a-8ddb-4b39-9659-764727cccdc2: deleting {{(pid=88137) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-97206acc-774a-41f5-abc5-18c7bc75cfad" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-97206acc-774a-41f5-abc5-18c7bc75cfad" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Deleting offline snapshot 8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d of volume 97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:06:41 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] snapshot_file for this snap is: volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.346s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:06:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8f8d1f3f-a545-4cee-a349-c0a4831270f0 tempest-GroupSnapshotsTest-423018851 None] Delete group completed successfully. Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0927371-831d-4520-8eea-d51f8da794fb]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:41 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d Sep 10 20:06:41 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:41 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d" returned: 0 in 0.595s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97206acc-774a-41f5-abc5-18c7bc75cfad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0e1359-aa45-4da7-8cf4-44da4490e52e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:06:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:42 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad Sep 10 20:06:42 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:42 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad" returned: 0 in 1.048s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:43 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d Sep 10 20:06:43 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:43 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d" returned: 0 in 0.586s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:43 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d Sep 10 20:06:43 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:44 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad.8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d" returned: 0 in 0.530s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-8cb7b78f-6c0a-4244-b7b1-3a8d91ff0d7d" released by "_delete_snapshot" :: held 2.917s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-97206acc-774a-41f5-abc5-18c7bc75cfad" released by "delete_snapshot" :: held 2.939s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:44 devstack cinder-volume[88137]: WARNING cinder.quota [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-118291834 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-118291834, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:06:44 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] Created reservations ['b13693ee-c1ae-45e7-835c-f03653bce4c8', 'e97b722a-c2a2-456a-90c9-e3b4352dfe4a', '6a22d6a8-ed42-4f4f-bd5c-f5eb8b4b3aad', 'a485b767-5bb0-410f-889b-a305493c1388'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:06:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-40bc61c8-f7d5-4168-b07f-fc9c18968cb0 tempest-GroupSnapshotsTest-423018851 None] group_snapshot a732578a-8ddb-4b39-9659-764727cccdc2: deleted successfully Sep 10 20:06:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-97206acc-774a-41f5-abc5-18c7bc75cfad" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:06:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-97206acc-774a-41f5-abc5-18c7bc75cfad" acquired by "delete_volume" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:06:45 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[767f3799-f229-41ae-8886-614b5df14774]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:06:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:45 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad Sep 10 20:06:45 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:46 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad" returned: 0 in 0.620s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:46 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad Sep 10 20:06:46 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:46 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-97206acc-774a-41f5-abc5-18c7bc75cfad" returned: 0 in 0.477s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-97206acc-774a-41f5-abc5-18c7bc75cfad" released by "delete_volume" :: held 1.244s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:06:46 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Created reservations ['3e6445a3-ad53-4ad7-8e60-5cfc15ac0ec2'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:06:46 devstack cinder-volume[88137]: WARNING cinder.db.api [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-118291834'] Sep 10 20:06:46 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Created reservations ['cd931b53-a354-43e3-8e40-18607b679f19', '771baacd-625c-45e8-aeec-f7e5f88c3034', '3cdcc709-5a52-4da2-a8a5-cf793ed8cf55', '837144c7-628a-43c4-af3b-524e6d29736a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:06:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:47 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:06:47 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:47 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.500s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:47 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:06:47 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8009ec56-4548-489e-b1bb-8e2df9590982 tempest-GroupSnapshotsTest-423018851 None] Delete group completed successfully. Sep 10 20:06:48 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:06:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Flow 'volume_create_manager' (d4e4c922-2e99-405b-8d33-76fd9c7fb7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:06:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf3371a-7114-403c-a12f-99bbeb28507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf3371a-7114-403c-a12f-99bbeb28507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-838246644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37de651d-26ee-4d66-a410-02d4bfbc81de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8bc15b5b5ce49e49ef36456336afdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:06:49Z,use_quota=True,user_id='782e0c5360b34ba495054dd63b670358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a38d1c-c2e9-4c9f-bd07-1fa85162c886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a38d1c-c2e9-4c9f-bd07-1fa85162c886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd64cc25-11c1-4676-998c-51949fef19a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd64cc25-11c1-4676-998c-51949fef19a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37de651d-26ee-4d66-a410-02d4bfbc81de', 'volume_name': 'volume-37de651d-26ee-4d66-a410-02d4bfbc81de', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b20e9db-9425-4fd8-bad6-eb20fdb0cabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b20e9db-9425-4fd8-bad6-eb20fdb0cabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47342ce-49ef-4bd2-854a-01fd260254e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:49 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Volume 37de651d-26ee-4d66-a410-02d4bfbc81de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37de651d-26ee-4d66-a410-02d4bfbc81de', 'volume_size': 1} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-838246644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37de651d-26ee-4d66-a410-02d4bfbc81de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8bc15b5b5ce49e49ef36456336afdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:06:49Z,use_quota=True,user_id='782e0c5360b34ba495054dd63b670358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Creating volume 37de651d-26ee-4d66-a410-02d4bfbc81de {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:06:49 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:06:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-672a1913-c7ff-485c-abc5-0ba2cd93037f tempest-GroupSnapshotsTest-423018851 None] Group tempest-GroupSnapshotsTest-Group-1653192288: creating Sep 10 20:06:49 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de 1073741824 Sep 10 20:06:49 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-672a1913-c7ff-485c-abc5-0ba2cd93037f tempest-GroupSnapshotsTest-423018851 None] Group tempest-GroupSnapshotsTest-Group-1653192288: created successfully Sep 10 20:06:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-672a1913-c7ff-485c-abc5-0ba2cd93037f tempest-GroupSnapshotsTest-423018851 None] Create group completed successfully. Sep 10 20:06:50 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de 1073741824" returned: 0 in 0.961s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:50 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de Sep 10 20:06:50 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:50 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de" returned: 0 in 0.864s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:06:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47342ce-49ef-4bd2-854a-01fd260254e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37de651d-26ee-4d66-a410-02d4bfbc81de', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301e7724-012f-492e-9c91-2ea7e15b87c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Volume volume-37de651d-26ee-4d66-a410-02d4bfbc81de (37de651d-26ee-4d66-a410-02d4bfbc81de): created successfully Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301e7724-012f-492e-9c91-2ea7e15b87c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Flow 'volume_create_manager' (d4e4c922-2e99-405b-8d33-76fd9c7fb7c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:06:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-25c72501-5ba6-4549-8ab6-d3b1121df339 tempest-ServerActionsTestOtherA-528726344 None] Created volume successfully. Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Flow 'volume_create_manager' (784c3b23-1e64-4830-be49-228a9db6ef97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36625dd7-bca2-40da-b8a3-b97649a70687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36625dd7-bca2-40da-b8a3-b97649a70687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-952709710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b6c1620-4bca-4e62-9467-5659fe0b743d,host='devstack@QuobyteHD#QuobyteHD',id=499d8d8d-39e7-457a-ac59-766143695bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c989e93e893474fb59d327961e20640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:06:51Z,use_quota=True,user_id='2acdcc1ea8ae44abb7ec29b3ad1cc157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be8e8e02-eaf4-4709-9105-0ec157dc8aa0),volume_type_id=be8e8e02-eaf4-4709-9105-0ec157dc8aa0)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fda77d-db68-4edb-8090-49dfa0c049a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fda77d-db68-4edb-8090-49dfa0c049a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b40932-eb2e-4fed-962d-ccccfe8bf7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b40932-eb2e-4fed-962d-ccccfe8bf7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499d8d8d-39e7-457a-ac59-766143695bf4', 'volume_name': 'volume-499d8d8d-39e7-457a-ac59-766143695bf4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddb5782-56a2-496e-8500-4fa83837d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddb5782-56a2-496e-8500-4fa83837d69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb934c3-7e05-4ace-822e-b0c9adcd0587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Volume 499d8d8d-39e7-457a-ac59-766143695bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499d8d8d-39e7-457a-ac59-766143695bf4', 'volume_size': 1} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5b6c1620-4bca-4e62-9467-5659fe0b743d,created_at=2026-09-10T18:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-952709710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b6c1620-4bca-4e62-9467-5659fe0b743d,host='devstack@QuobyteHD#QuobyteHD',id=499d8d8d-39e7-457a-ac59-766143695bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c989e93e893474fb59d327961e20640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:06:51Z,use_quota=True,user_id='2acdcc1ea8ae44abb7ec29b3ad1cc157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be8e8e02-eaf4-4709-9105-0ec157dc8aa0),volume_type_id=be8e8e02-eaf4-4709-9105-0ec157dc8aa0)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Creating volume 499d8d8d-39e7-457a-ac59-766143695bf4 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:06:51 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:06:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:51 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 1073741824 Sep 10 20:06:51 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:52 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 1073741824" returned: 0 in 0.635s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:52 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 Sep 10 20:06:52 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:52 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4" returned: 0 in 0.434s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:06:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb934c3-7e05-4ace-822e-b0c9adcd0587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499d8d8d-39e7-457a-ac59-766143695bf4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5711bb8-6b1c-4cf9-8529-9ba9c936ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:52 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Volume volume-499d8d8d-39e7-457a-ac59-766143695bf4 (499d8d8d-39e7-457a-ac59-766143695bf4): created successfully Sep 10 20:06:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5711bb8-6b1c-4cf9-8529-9ba9c936ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Flow 'volume_create_manager' (784c3b23-1e64-4830-be49-228a9db6ef97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:06:52 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-7f1645df-d26a-4700-87cd-a5a955c4a75f tempest-GroupSnapshotsTest-423018851 None] Created volume successfully. Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Flow 'volume_create_manager' (88ecf4dd-1675-4c92-93e8-4332cbd0caab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7b4aab-0f41-4c45-b010-0812b4ac10ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7b4aab-0f41-4c45-b010-0812b4ac10ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1403970247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b6c1620-4bca-4e62-9467-5659fe0b743d,host='devstack@QuobyteHD#QuobyteHD',id=f3c38b45-64f8-4982-9a84-f60ebacf7b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c989e93e893474fb59d327961e20640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:06:55Z,use_quota=True,user_id='2acdcc1ea8ae44abb7ec29b3ad1cc157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be8e8e02-eaf4-4709-9105-0ec157dc8aa0),volume_type_id=be8e8e02-eaf4-4709-9105-0ec157dc8aa0)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cabadf-1cde-45cc-8be5-713e1973b118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cabadf-1cde-45cc-8be5-713e1973b118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1257b09-b9ad-47dd-9ca7-28d93db3a6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1257b09-b9ad-47dd-9ca7-28d93db3a6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c38b45-64f8-4982-9a84-f60ebacf7b24', 'volume_name': 'volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c0da9-71aa-427c-85d3-9f02b35f989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c0da9-71aa-427c-85d3-9f02b35f989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62185887-20f7-440b-a4c1-adaf20118042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:55 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Volume f3c38b45-64f8-4982-9a84-f60ebacf7b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24', 'volume_size': 1} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5b6c1620-4bca-4e62-9467-5659fe0b743d,created_at=2026-09-10T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1403970247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b6c1620-4bca-4e62-9467-5659fe0b743d,host='devstack@QuobyteHD#QuobyteHD',id=f3c38b45-64f8-4982-9a84-f60ebacf7b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c989e93e893474fb59d327961e20640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:06:55Z,use_quota=True,user_id='2acdcc1ea8ae44abb7ec29b3ad1cc157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be8e8e02-eaf4-4709-9105-0ec157dc8aa0),volume_type_id=be8e8e02-eaf4-4709-9105-0ec157dc8aa0)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Creating volume f3c38b45-64f8-4982-9a84-f60ebacf7b24 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:06:55 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:06:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:55 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 1073741824 Sep 10 20:06:55 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:56 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 1073741824" returned: 0 in 1.016s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:06:56 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 Sep 10 20:06:56 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:06:57 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Sep 10 20:06:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24" returned: 0 in 0.552s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:06:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:06:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:06:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62185887-20f7-440b-a4c1-adaf20118042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49e0c6e-9fa0-464b-86d6-cf3421395016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:06:57 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Volume volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 (f3c38b45-64f8-4982-9a84-f60ebacf7b24): created successfully Sep 10 20:06:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49e0c6e-9fa0-464b-86d6-cf3421395016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:06:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Flow 'volume_create_manager' (88ecf4dd-1675-4c92-93e8-4332cbd0caab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:06:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-01634cd8-7fe1-4834-abb4-5ef7d8dfe5f9 tempest-GroupSnapshotsTest-423018851 None] Created volume successfully. Sep 10 20:06:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b72ecb07-140b-4faf-83ab-2afd5e59c2cc tempest-GroupSnapshotsTest-423018851 None] Update group completed successfully. Sep 10 20:06:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-660ef4e6-7d4a-45d9-b9a1-d0cdf947ec93 tempest-GroupSnapshotsTest-423018851 None] Update group completed successfully. Sep 10 20:07:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f2eeab6c-d992-483e-a225-af9c59dd2104 tempest-GroupSnapshotsTest-423018851 None] Update group completed successfully. Sep 10 20:07:02 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c20826a0-93b5-4cdc-90e5-8fe7472e4094 tempest-GroupSnapshotsTest-423018851 None] Update group completed successfully. Sep 10 20:07:04 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] GroupSnapshot 46240ba5-07b4-4995-9960-489afc97a366: creating. Sep 10 20:07:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Group snapshot 46240ba5-07b4-4995-9960-489afc97a366: creating. {{(pid=88137) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 20:07:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Creating offline snapshot 7b404385-b83b-4c13-9969-4b142f9ac795 of volume 499d8d8d-39e7-457a-ac59-766143695bf4 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:07:04 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0f33c2-89cb-498a-8d7c-740bddda4ff7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:04 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 Sep 10 20:07:04 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:05 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4" returned: 0 in 0.912s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:05 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 1G Sep 10 20:07:05 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:06 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 1G" returned: 0 in 0.866s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-499d8d8d-39e7-457a-ac59-766143695bf4 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:06 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-499d8d8d-39e7-457a-ac59-766143695bf4 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 Sep 10 20:07:06 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:06 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-499d8d8d-39e7-457a-ac59-766143695bf4 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795" returned: 0 in 0.329s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:06 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:07:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:06 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 Sep 10 20:07:06 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:06 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795" returned: 0 in 0.325s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:07 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.info Sep 10 20:07:07 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:07 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.info" returned: 0 in 0.665s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:07 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:07:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:07 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.info Sep 10 20:07:07 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:07 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.info" returned: 0 in 0.360s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.608s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Creating offline snapshot f530d576-2d50-4a72-aaba-18b598b92c82 of volume f3c38b45-64f8-4982-9a84-f60ebacf7b24 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:07:08 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4317f906-03f0-4519-ae1a-a33fab011369]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:08 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 Sep 10 20:07:08 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:08 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24" returned: 0 in 0.507s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:08 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 1G Sep 10 20:07:08 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:09 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 1G" returned: 0 in 0.599s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:09 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 Sep 10 20:07:09 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:09 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82" returned: 0 in 0.539s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:09 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:07:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:09 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 Sep 10 20:07:09 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:10 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82" returned: 0 in 0.340s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:10 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.info Sep 10 20:07:10 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:10 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.info" returned: 0 in 0.516s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:10 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:07:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:10 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.info Sep 10 20:07:10 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:10 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.info" returned: 0 in 0.296s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.940s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:11 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-76941b76-9686-44ac-a2f8-14ed34d2329f tempest-GroupSnapshotsTest-423018851 None] group_snapshot 46240ba5-07b4-4995-9960-489afc97a366: created successfully Sep 10 20:07:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] group_snapshot 46240ba5-07b4-4995-9960-489afc97a366: deleting Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=81,cinder:UPDATE=57,cinder:INSERT=16,cinder:DELETE=3 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] group_snapshot 46240ba5-07b4-4995-9960-489afc97a366: deleting {{(pid=88137) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=71,cinder:UPDATE=68,cinder:INSERT=10,cinder:DELETE=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-499d8d8d-39e7-457a-ac59-766143695bf4" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-499d8d8d-39e7-457a-ac59-766143695bf4" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-7b404385-b83b-4c13-9969-4b142f9ac795" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-7b404385-b83b-4c13-9969-4b142f9ac795" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Deleting offline snapshot 7b404385-b83b-4c13-9969-4b142f9ac795 of volume 499d8d8d-39e7-457a-ac59-766143695bf4 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] snapshot_file for this snap is: volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[427b89a4-530e-4396-af02-854054682753]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:07:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Flow 'volume_create_manager' (d19df6fb-739c-4ec5-bddd-ccaa9a6944d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f0145a-57f2-4673-beff-7c6bc8cea9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:13 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 Sep 10 20:07:13 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f0145a-57f2-4673-beff-7c6bc8cea9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-624621094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e693ef60-7c29-4197-bf0e-dd8bc24a1a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c08f03c6604421091c6287433f8f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:07:13Z,use_quota=True,user_id='e2cec5553f764b40ae6be0b6ac1d628e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a208baba-c815-40ef-a344-6bd767ef5f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a208baba-c815-40ef-a344-6bd767ef5f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acfd0ec-09bd-4441-80ad-2a4a33f7347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acfd0ec-09bd-4441-80ad-2a4a33f7347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e693ef60-7c29-4197-bf0e-dd8bc24a1a58', 'volume_name': 'volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862a0600-dbd9-45a8-9726-841db2e111bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862a0600-dbd9-45a8-9726-841db2e111bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc259c4-5d7e-4707-bea6-5872ce505778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:13 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Volume e693ef60-7c29-4197-bf0e-dd8bc24a1a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58', 'volume_size': 1} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-624621094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e693ef60-7c29-4197-bf0e-dd8bc24a1a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c08f03c6604421091c6287433f8f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:07:13Z,use_quota=True,user_id='e2cec5553f764b40ae6be0b6ac1d628e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Creating volume e693ef60-7c29-4197-bf0e-dd8bc24a1a58 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:07:13 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:13 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 1073741824 Sep 10 20:07:13 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:13 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795" returned: 0 in 0.591s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-499d8d8d-39e7-457a-ac59-766143695bf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[87888642-21d9-4dfb-8e30-408538d94c6d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:13 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 Sep 10 20:07:13 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:14 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 1073741824" returned: 0 in 0.923s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:14 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 Sep 10 20:07:14 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:14 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4" returned: 0 in 0.814s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:14 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 Sep 10 20:07:14 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:14 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58" returned: 0 in 0.423s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc259c4-5d7e-4707-bea6-5872ce505778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd0e6d3-8fba-49bd-8021-528a127612c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:14 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Volume volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 (e693ef60-7c29-4197-bf0e-dd8bc24a1a58): created successfully Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd0e6d3-8fba-49bd-8021-528a127612c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Flow 'volume_create_manager' (d19df6fb-739c-4ec5-bddd-ccaa9a6944d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:07:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a6de914f-db71-409a-8769-c3c1af10966f tempest-ServersNegativeTestJSON-171055750 None] Created volume successfully. Sep 10 20:07:14 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795" returned: 0 in 0.696s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:15 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795 Sep 10 20:07:15 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:15 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4.7b404385-b83b-4c13-9969-4b142f9ac795" returned: 0 in 0.611s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-7b404385-b83b-4c13-9969-4b142f9ac795" released by "_delete_snapshot" :: held 2.962s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-499d8d8d-39e7-457a-ac59-766143695bf4" released by "delete_snapshot" :: held 3.048s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-f3c38b45-64f8-4982-9a84-f60ebacf7b24" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-f3c38b45-64f8-4982-9a84-f60ebacf7b24" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-f530d576-2d50-4a72-aaba-18b598b92c82" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-f530d576-2d50-4a72-aaba-18b598b92c82" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Deleting offline snapshot f530d576-2d50-4a72-aaba-18b598b92c82 of volume f3c38b45-64f8-4982-9a84-f60ebacf7b24 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:07:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] snapshot_file for this snap is: volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:07:16 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c853428-963b-4bb3-90c5-2ffa9763d868]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:16 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 Sep 10 20:07:16 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:16 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82" returned: 0 in 0.660s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:07:16 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[838698bd-0e4e-489e-bd19-abe3264ca7b1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:17 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 Sep 10 20:07:17 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:17 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24" returned: 0 in 0.803s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:17 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 Sep 10 20:07:17 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Flow 'volume_create_manager' (c442e2e5-28dd-4f82-a83a-0f2694ed45c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9952921-fe2e-4c71-92af-a13feaf2774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9952921-fe2e-4c71-92af-a13feaf2774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2102844126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00dd2345-e7c3-470c-82cf-6b34c008e236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c08f03c6604421091c6287433f8f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:07:18Z,use_quota=True,user_id='e2cec5553f764b40ae6be0b6ac1d628e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ad5065-2c39-4640-9b25-dac12a568a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ad5065-2c39-4640-9b25-dac12a568a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47261820-b6a1-44d9-a065-d7d7515b66b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47261820-b6a1-44d9-a065-d7d7515b66b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00dd2345-e7c3-470c-82cf-6b34c008e236', 'volume_name': 'volume-00dd2345-e7c3-470c-82cf-6b34c008e236', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:18 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4e3c0f-27b8-4b37-bea4-9ad30512c9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4e3c0f-27b8-4b37-bea4-9ad30512c9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4089d09f-2216-495e-b525-ffff50cb1f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:18 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Volume 00dd2345-e7c3-470c-82cf-6b34c008e236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00dd2345-e7c3-470c-82cf-6b34c008e236', 'volume_size': 1} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2102844126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00dd2345-e7c3-470c-82cf-6b34c008e236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c08f03c6604421091c6287433f8f154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:07:18Z,use_quota=True,user_id='e2cec5553f764b40ae6be0b6ac1d628e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Creating volume 00dd2345-e7c3-470c-82cf-6b34c008e236 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:07:18 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82" returned: 0 in 0.692s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:18 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236 1073741824 Sep 10 20:07:18 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:18 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82 Sep 10 20:07:18 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:18 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24.f530d576-2d50-4a72-aaba-18b598b92c82" returned: 0 in 0.530s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-f530d576-2d50-4a72-aaba-18b598b92c82" released by "_delete_snapshot" :: held 2.967s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-f3c38b45-64f8-4982-9a84-f60ebacf7b24" released by "delete_snapshot" :: held 3.059s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:19 devstack cinder-volume[88137]: WARNING cinder.quota [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1374183466 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1374183466, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:07:19 devstack cinder-volume[88137]: WARNING cinder.quota [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1374183466 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1374183466, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:07:19 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236 1073741824" returned: 0 in 0.849s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Created reservations ['e914e587-daf4-437a-a489-8b324795cc70', '10f307b7-0dcf-41e3-ac60-1f747592318f', '7caec170-55f5-4bb4-86df-c1c2aa9dfdd9', '26b25e6f-5f02-42cb-9344-f9a226834f6e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:19 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236 Sep 10 20:07:19 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] Created reservations ['ca382df2-423b-49d0-8dfc-83ae2e16be39', 'da70781f-eaab-4b27-a5d2-08d20e8bc0ea', '0618f8ac-1a40-410f-80ce-a9c28064820d', 'db599ae4-3754-48ff-99f5-ca6d9a380dd8'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-556af5c9-8b45-4107-bf63-7efb3e2f32ca tempest-GroupSnapshotsTest-423018851 None] group_snapshot 46240ba5-07b4-4995-9960-489afc97a366: deleted successfully Sep 10 20:07:19 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236" returned: 0 in 0.419s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4089d09f-2216-495e-b525-ffff50cb1f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00dd2345-e7c3-470c-82cf-6b34c008e236', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78db077c-8d6f-410b-8584-bb1bac498c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Volume volume-00dd2345-e7c3-470c-82cf-6b34c008e236 (00dd2345-e7c3-470c-82cf-6b34c008e236): created successfully Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78db077c-8d6f-410b-8584-bb1bac498c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Flow 'volume_create_manager' (c442e2e5-28dd-4f82-a83a-0f2694ed45c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:07:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-bc1493aa-c28c-4dc3-a214-185114e12923 tempest-ServersNegativeTestJSON-171055750 None] Created volume successfully. Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-499d8d8d-39e7-457a-ac59-766143695bf4" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-499d8d8d-39e7-457a-ac59-766143695bf4" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[90467f7f-6e5f-4d19-893a-b5626aa31c50]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:20 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:07:20 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:20 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 Sep 10 20:07:20 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:20 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.404s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:07:20 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4" returned: 0 in 0.578s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:20 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4 Sep 10 20:07:20 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:21 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-499d8d8d-39e7-457a-ac59-766143695bf4" returned: 0 in 0.436s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-499d8d8d-39e7-457a-ac59-766143695bf4" released by "delete_volume" :: held 1.116s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-f3c38b45-64f8-4982-9a84-f60ebacf7b24" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-f3c38b45-64f8-4982-9a84-f60ebacf7b24" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3754788-f077-4ffe-8b7d-47ac3092e61c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:21 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 Sep 10 20:07:21 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "cinder-00dd2345-e7c3-470c-82cf-6b34c008e236-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Lock "cinder-00dd2345-e7c3-470c-82cf-6b34c008e236-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "cinder-quobyte-00dd2345-e7c3-470c-82cf-6b34c008e236" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Lock "cinder-quobyte-00dd2345-e7c3-470c-82cf-6b34c008e236" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[813caff1-2073-4560-8e76-006582a07a99]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:22 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24" returned: 0 in 0.556s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:22 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24 Sep 10 20:07:22 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:22 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236 Sep 10 20:07:22 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:22 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3c38b45-64f8-4982-9a84-f60ebacf7b24" returned: 0 in 0.510s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-f3c38b45-64f8-4982-9a84-f60ebacf7b24" released by "delete_volume" :: held 1.170s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:22 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236" returned: 0 in 0.577s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:22 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236 Sep 10 20:07:22 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:22 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Created reservations ['a2d6d18f-991d-4a21-9c6a-511266bd6710'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:22 devstack cinder-volume[88137]: WARNING cinder.quota [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1374183466 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1374183466, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:07:22 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Created reservations ['458e04df-43cd-4ee6-9235-86a1a950c342', '2a075e1e-a450-40b5-a029-dfa3ef1b03f8', '6dc577d4-82af-4372-b2a5-9c4962e4fe8e', '124558e0-2626-4be5-b132-a4f157ddc7af'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:23 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00dd2345-e7c3-470c-82cf-6b34c008e236" returned: 0 in 0.695s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Lock "cinder-quobyte-00dd2345-e7c3-470c-82cf-6b34c008e236" released by "delete_volume" :: held 1.356s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Created reservations ['1859f583-2ae7-4b14-bb2b-b289a110fe62', '1148a3ff-8f85-48af-b81f-25dbdcc3b06f', '9f499f1c-212b-48f8-8852-4cbb72caf914', '6f8a6140-5b70-414a-9e8b-43c8fa8d04e3'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Created reservations ['f376382f-8e91-472d-bac7-16c056e32730', 'fa596231-92f2-4e17-984a-3e77d0985a55', 'b9ebc3f9-b022-4396-897a-7017ec762045', '8399ebbe-3710-436e-9f12-a0f619e6f5bd'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:23 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:07:23 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:23 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:07:23 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:23 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.386s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:23 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:07:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Deleted volume successfully. Sep 10 20:07:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe05d735-76bb-421f-aa9d-c68c4f191d46 tempest-ServersNegativeTestJSON-171055750 None] Lock "cinder-00dd2345-e7c3-470c-82cf-6b34c008e236-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:24 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.406s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:24 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:07:24 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8330bff5-5288-439a-9fbf-0a7cbf0c347e tempest-GroupSnapshotsTest-423018851 None] Delete group completed successfully. Sep 10 20:07:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "cinder-e693ef60-7c29-4197-bf0e-dd8bc24a1a58-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Lock "cinder-e693ef60-7c29-4197-bf0e-dd8bc24a1a58-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "cinder-quobyte-e693ef60-7c29-4197-bf0e-dd8bc24a1a58" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Lock "cinder-quobyte-e693ef60-7c29-4197-bf0e-dd8bc24a1a58" acquired by "delete_volume" :: waited 0.076s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5191afc-ca61-4295-826d-79dba09e3b84]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:25 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 Sep 10 20:07:25 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:25 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4290eaf3-2343-4b28-9313-72e3bfb4764d tempest-GroupSnapshotsTest-423018851 None] Group tempest-GroupSnapshotsTest-Group-755844308: creating Sep 10 20:07:25 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4290eaf3-2343-4b28-9313-72e3bfb4764d tempest-GroupSnapshotsTest-423018851 None] Group tempest-GroupSnapshotsTest-Group-755844308: created successfully Sep 10 20:07:25 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4290eaf3-2343-4b28-9313-72e3bfb4764d tempest-GroupSnapshotsTest-423018851 None] Create group completed successfully. Sep 10 20:07:25 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58" returned: 0 in 0.804s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:25 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58 Sep 10 20:07:25 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:26 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e693ef60-7c29-4197-bf0e-dd8bc24a1a58" returned: 0 in 0.785s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Lock "cinder-quobyte-e693ef60-7c29-4197-bf0e-dd8bc24a1a58" released by "delete_volume" :: held 1.725s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:26 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Created reservations ['1d575031-53a1-40cf-b3db-371d6733d01a', '4b5dcbbd-bc0b-42a9-a2fe-5c07620c7b94', '942ca07c-639a-4cae-9195-ec8cb9e324ad', 'b9506faf-c5b9-4911-ab83-6b2ab94c7f91'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:07:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:07:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:26 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:07:26 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:27 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.401s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:27 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:07:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Deleted volume successfully. Sep 10 20:07:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-420a7882-f998-4213-9f95-a60e47c715bd tempest-ServersNegativeTestJSON-171055750 None] Lock "cinder-e693ef60-7c29-4197-bf0e-dd8bc24a1a58-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:27 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Flow 'volume_create_manager' (5cf69e8f-32c1-4de2-9379-ec2c62f61f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a24115-e464-497c-b65f-164f5d2f43a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a24115-e464-497c-b65f-164f5d2f43a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1171505168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9b6826f-cd56-422b-9bf4-46ff34e73ab9,host='devstack@QuobyteHD#QuobyteHD',id=761d9203-ab85-4353-a82b-00bd3ba38c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c989e93e893474fb59d327961e20640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:07:28Z,use_quota=True,user_id='2acdcc1ea8ae44abb7ec29b3ad1cc157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c28e73dd-9779-48cb-b9ea-8334c92c47d9),volume_type_id=c28e73dd-9779-48cb-b9ea-8334c92c47d9)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e68ce-3be8-48b4-845f-dc1646c0a663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e68ce-3be8-48b4-845f-dc1646c0a663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb75abc0-1ab3-4db7-862b-5d9fbc2dd8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb75abc0-1ab3-4db7-862b-5d9fbc2dd8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761d9203-ab85-4353-a82b-00bd3ba38c62', 'volume_name': 'volume-761d9203-ab85-4353-a82b-00bd3ba38c62', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee59527c-93b9-4f21-9efa-ff8130c3a3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee59527c-93b9-4f21-9efa-ff8130c3a3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80156b0-f89f-48c5-a072-1732bf4c03eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:28 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Volume 761d9203-ab85-4353-a82b-00bd3ba38c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761d9203-ab85-4353-a82b-00bd3ba38c62', 'volume_size': 1} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9b6826f-cd56-422b-9bf4-46ff34e73ab9,created_at=2026-09-10T18:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1171505168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9b6826f-cd56-422b-9bf4-46ff34e73ab9,host='devstack@QuobyteHD#QuobyteHD',id=761d9203-ab85-4353-a82b-00bd3ba38c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c989e93e893474fb59d327961e20640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:07:28Z,use_quota=True,user_id='2acdcc1ea8ae44abb7ec29b3ad1cc157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c28e73dd-9779-48cb-b9ea-8334c92c47d9),volume_type_id=c28e73dd-9779-48cb-b9ea-8334c92c47d9)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Creating volume 761d9203-ab85-4353-a82b-00bd3ba38c62 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:07:28 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:07:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:28 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 1073741824 Sep 10 20:07:28 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:29 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 1073741824" returned: 0 in 1.401s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:29 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 Sep 10 20:07:29 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:30 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62" returned: 0 in 0.402s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:07:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80156b0-f89f-48c5-a072-1732bf4c03eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761d9203-ab85-4353-a82b-00bd3ba38c62', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6247937-5f16-47dd-9820-ebf8ef3e3d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Volume volume-761d9203-ab85-4353-a82b-00bd3ba38c62 (761d9203-ab85-4353-a82b-00bd3ba38c62): created successfully Sep 10 20:07:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6247937-5f16-47dd-9820-ebf8ef3e3d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Flow 'volume_create_manager' (5cf69e8f-32c1-4de2-9379-ec2c62f61f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:07:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-80aa83d5-bf06-40ef-86fc-fe940294aab1 tempest-GroupSnapshotsTest-423018851 None] Created volume successfully. Sep 10 20:07:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] GroupSnapshot b16759c3-e4b8-4eaa-b371-1ec8ae70501e: creating. Sep 10 20:07:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Group snapshot b16759c3-e4b8-4eaa-b371-1ec8ae70501e: creating. {{(pid=88137) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 20:07:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Creating offline snapshot 6de9217f-8987-4988-9d8e-cb3aad9a0610 of volume 761d9203-ab85-4353-a82b-00bd3ba38c62 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:07:32 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3712b8c-35de-4241-8e7f-01f5e4cfc9d7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:32 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 Sep 10 20:07:32 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:33 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62" returned: 0 in 1.078s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:33 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 1G Sep 10 20:07:33 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-2681dd05-51e7-48e2-a30e-2fb26c422048 req-04eec94f-a4b4-4484-a5a6-2efa0258de26 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:34 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 1G" returned: 0 in 0.803s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-761d9203-ab85-4353-a82b-00bd3ba38c62 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:34 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-761d9203-ab85-4353-a82b-00bd3ba38c62 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 Sep 10 20:07:34 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:34 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-761d9203-ab85-4353-a82b-00bd3ba38c62 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610" returned: 0 in 0.481s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:34 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:07:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:34 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 Sep 10 20:07:34 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:34 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610" returned: 0 in 0.357s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:34 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.info Sep 10 20:07:34 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:35 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.info" returned: 0 in 0.402s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:35 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:07:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:35 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.info Sep 10 20:07:35 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:35 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.info" returned: 0 in 0.400s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.706s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-2681dd05-51e7-48e2-a30e-2fb26c422048 req-04eec94f-a4b4-4484-a5a6-2efa0258de26 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.162s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-2681dd05-51e7-48e2-a30e-2fb26c422048 req-04eec94f-a4b4-4484-a5a6-2efa0258de26 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-2681dd05-51e7-48e2-a30e-2fb26c422048 req-04eec94f-a4b4-4484-a5a6-2efa0258de26 tempest-ServerActionsTestOtherA-528726344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-37de651d-26ee-4d66-a410-02d4bfbc81de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2cd56fb-70eb-4825-82a3-4de40a7bba8f', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:07:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-994a83a6-68e4-489e-9de4-954f937248f6 tempest-GroupSnapshotsTest-423018851 None] group_snapshot b16759c3-e4b8-4eaa-b371-1ec8ae70501e: created successfully Sep 10 20:07:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-2681dd05-51e7-48e2-a30e-2fb26c422048 req-04eec94f-a4b4-4484-a5a6-2efa0258de26 tempest-ServerActionsTestOtherA-528726344 None] attachment_update completed successfully. Sep 10 20:07:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] group_snapshot b16759c3-e4b8-4eaa-b371-1ec8ae70501e: deleting Sep 10 20:07:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] group_snapshot b16759c3-e4b8-4eaa-b371-1ec8ae70501e: deleting {{(pid=88137) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 20:07:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-761d9203-ab85-4353-a82b-00bd3ba38c62" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-761d9203-ab85-4353-a82b-00bd3ba38c62" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-6de9217f-8987-4988-9d8e-cb3aad9a0610" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-6de9217f-8987-4988-9d8e-cb3aad9a0610" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Deleting offline snapshot 6de9217f-8987-4988-9d8e-cb3aad9a0610 of volume 761d9203-ab85-4353-a82b-00bd3ba38c62 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:07:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] snapshot_file for this snap is: volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:07:37 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cad511-a85e-4e3b-a8ca-c386e562c02b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:37 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 Sep 10 20:07:37 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:38 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610" returned: 0 in 0.950s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-761d9203-ab85-4353-a82b-00bd3ba38c62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:07:38 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98bfb7f-5071-4139-afca-106513fff9bc]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:38 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 Sep 10 20:07:38 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:38 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62" returned: 0 in 0.750s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:39 devstack sudo[92058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 Sep 10 20:07:39 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Flow 'volume_create_manager' (afed3ef4-2ea3-4d7c-94ce-584ee0a02fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f704691-c6e8-4f29-8d99-369a975ec3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f704691-c6e8-4f29-8d99-369a975ec3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-760340022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3efc0e8-d1be-4327-b666-05da5f49e295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcdb55ea081743618fbdce9531bb671f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:07:39Z,use_quota=True,user_id='c87e520c8c584438900b846370c30083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c21dfc-f007-42df-9f33-055fcc898bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c21dfc-f007-42df-9f33-055fcc898bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8393ca67-c928-44b3-8fb3-1c93a004e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8393ca67-c928-44b3-8fb3-1c93a004e769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3efc0e8-d1be-4327-b666-05da5f49e295', 'volume_name': 'volume-f3efc0e8-d1be-4327-b666-05da5f49e295', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac61cd4-11d8-46f1-8254-bb966ab29a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac61cd4-11d8-46f1-8254-bb966ab29a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4eb05a-3a25-4669-87d0-f8badb2b2933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:39 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Volume f3efc0e8-d1be-4327-b666-05da5f49e295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3efc0e8-d1be-4327-b666-05da5f49e295', 'volume_size': 1} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-760340022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3efc0e8-d1be-4327-b666-05da5f49e295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcdb55ea081743618fbdce9531bb671f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:07:39Z,use_quota=True,user_id='c87e520c8c584438900b846370c30083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Creating volume f3efc0e8-d1be-4327-b666-05da5f49e295 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:07:39 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:39 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295 1073741824 Sep 10 20:07:39 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:39 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610" returned: 0 in 0.755s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:39 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610 Sep 10 20:07:39 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:40 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295 1073741824" returned: 0 in 1.061s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:40 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62.6de9217f-8987-4988-9d8e-cb3aad9a0610" returned: 0 in 0.761s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:40 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295 Sep 10 20:07:40 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-6de9217f-8987-4988-9d8e-cb3aad9a0610" released by "_delete_snapshot" :: held 3.488s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-761d9203-ab85-4353-a82b-00bd3ba38c62" released by "delete_snapshot" :: held 3.545s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:40 devstack cinder-volume[88137]: WARNING cinder.quota [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2042801291 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2042801291, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:07:40 devstack cinder-volume[88137]: WARNING cinder.quota [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2042801291 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2042801291, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] Created reservations ['f15c2ea8-1171-4e6a-8516-047f0628a304', '99a110bf-42c9-4a60-8abf-d9e1dc01f9cd', '52f81b86-6106-4df7-9cd2-d005b869b5b7', 'aad8e0c8-38e8-49ca-bdf1-f32764291b2e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:40 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295" returned: 0 in 0.372s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4eb05a-3a25-4669-87d0-f8badb2b2933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3efc0e8-d1be-4327-b666-05da5f49e295', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f766663-ad9f-4ee7-8641-7dbed5cd9592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:07:40 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Volume volume-f3efc0e8-d1be-4327-b666-05da5f49e295 (f3efc0e8-d1be-4327-b666-05da5f49e295): created successfully Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f766663-ad9f-4ee7-8641-7dbed5cd9592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:07:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Flow 'volume_create_manager' (afed3ef4-2ea3-4d7c-94ce-584ee0a02fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:07:40 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d321c106-9491-435b-a4cb-ba4d15de5644 tempest-ServerRescueNegativeTestJSON-674562095 None] Created volume successfully. Sep 10 20:07:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d95be2f7-4961-4f1f-b2fe-003b525be381 tempest-GroupSnapshotsTest-423018851 None] group_snapshot b16759c3-e4b8-4eaa-b371-1ec8ae70501e: deleted successfully Sep 10 20:07:42 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-20a3330b-522d-4877-b31b-a902f990e071 req-0bf7cfe2-e3ad-4218-8df6-7a7495df888c tempest-ServerActionsTestOtherA-528726344 None] Terminate volume connection completed successfully. Sep 10 20:07:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-20a3330b-522d-4877-b31b-a902f990e071 req-0bf7cfe2-e3ad-4218-8df6-7a7495df888c tempest-ServerActionsTestOtherA-528726344 None] Deleting attachment b2cd56fb-70eb-4825-82a3-4de40a7bba8f. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:07:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "cinder-quobyte-761d9203-ab85-4353-a82b-00bd3ba38c62" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-761d9203-ab85-4353-a82b-00bd3ba38c62" acquired by "delete_volume" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:42 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7c2116-5051-407a-aac5-1f7e7a31470d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:42 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 Sep 10 20:07:42 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:43 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62" returned: 0 in 0.837s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:43 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62 Sep 10 20:07:43 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-20a3330b-522d-4877-b31b-a902f990e071 req-3d6c2300-971a-4339-b832-b38407180ab8 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-20a3330b-522d-4877-b31b-a902f990e071 req-3d6c2300-971a-4339-b832-b38407180ab8 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-20a3330b-522d-4877-b31b-a902f990e071 req-3d6c2300-971a-4339-b832-b38407180ab8 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-20a3330b-522d-4877-b31b-a902f990e071 req-3d6c2300-971a-4339-b832-b38407180ab8 tempest-ServerActionsTestOtherA-528726344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-37de651d-26ee-4d66-a410-02d4bfbc81de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad4d44ea-60c1-4bbc-a4a2-2b047631d2c0', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:07:43 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-761d9203-ab85-4353-a82b-00bd3ba38c62" returned: 0 in 0.524s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Lock "cinder-quobyte-761d9203-ab85-4353-a82b-00bd3ba38c62" released by "delete_volume" :: held 1.510s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:07:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-20a3330b-522d-4877-b31b-a902f990e071 req-3d6c2300-971a-4339-b832-b38407180ab8 tempest-ServerActionsTestOtherA-528726344 None] attachment_update completed successfully. Sep 10 20:07:44 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Created reservations ['538759ec-89db-41ad-86c0-43314e7232c5'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:44 devstack cinder-volume[88137]: WARNING cinder.quota [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2042801291 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2042801291, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:07:44 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Created reservations ['543881d4-fe27-400e-a4f5-909ab015c3a0', 'd3e5e20c-106b-48f1-bdde-456d3aa20b39', 'b17a52d0-344e-4bd9-8f9c-1e5c3085644d', '97af90bb-788e-4475-9e7e-afa4b4bc51fd'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:07:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:07:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:07:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:07:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:07:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:07:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:44 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:07:44 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:45 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.615s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:45 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:07:45 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-22f4da5c-b1a9-49af-a6ab-35b90b18ecf8 tempest-GroupSnapshotsTest-423018851 None] Delete group completed successfully. Sep 10 20:07:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=80,cinder:UPDATE=93,cinder:INSERT=15,cinder:DELETE=4 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:07:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=77,cinder:UPDATE=72,cinder:INSERT=24,cinder:DELETE=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:07:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Acquiring lock "cinder-f3efc0e8-d1be-4327-b666-05da5f49e295-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "cinder-f3efc0e8-d1be-4327-b666-05da5f49e295-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Acquiring lock "cinder-quobyte-f3efc0e8-d1be-4327-b666-05da5f49e295" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:07:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "cinder-quobyte-f3efc0e8-d1be-4327-b666-05da5f49e295" acquired by "delete_volume" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:07:58 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[771b0101-a342-4b5a-b27e-d6bfe9a03a47]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:07:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:58 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295 Sep 10 20:07:58 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:07:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-412ae9e0-2ea6-474f-bb32-d03e87408a40 tempest-GroupsV314Test-133608659 None] Group tempest-GroupsV314Test-Group-951073078: creating Sep 10 20:07:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-412ae9e0-2ea6-474f-bb32-d03e87408a40 tempest-GroupsV314Test-133608659 None] Group tempest-GroupsV314Test-Group-951073078: created successfully Sep 10 20:07:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-412ae9e0-2ea6-474f-bb32-d03e87408a40 tempest-GroupsV314Test-133608659 None] Create group completed successfully. Sep 10 20:07:59 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Sep 10 20:07:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295" returned: 0 in 0.804s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:07:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:07:59 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295 Sep 10 20:07:59 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:00 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f3efc0e8-d1be-4327-b666-05da5f49e295" returned: 0 in 0.701s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "cinder-quobyte-f3efc0e8-d1be-4327-b666-05da5f49e295" released by "delete_volume" :: held 1.617s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:00 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Created reservations ['93ad0fa2-38fd-4c78-aa75-16bd6f4986db', 'e0f93c07-66a2-4729-a0e4-596151a3c88e', '9e45f35b-e02f-4de1-83bb-a1245077fca5', 'b39e4496-925b-47c4-9ec5-9a5f32a377f1'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:00 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:08:00 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:01 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.469s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:01 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:08:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Deleted volume successfully. Sep 10 20:08:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3adf56b3-e9a8-4c7d-83ea-0a1555c88854 tempest-ServerRescueNegativeTestJSON-674562095 None] Lock "cinder-f3efc0e8-d1be-4327-b666-05da5f49e295-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Flow 'volume_create_manager' (43f3d498-fac6-42b9-91a8-842fa6b1e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442266f8-713c-497a-8530-98743cf3cf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442266f8-713c-497a-8530-98743cf3cf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-411315554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b8d1ce5-6765-4a26-aa42-ec64a0963474,host='devstack@QuobyteHD#QuobyteHD',id=feed66f2-cfb8-453c-97ae-82473191ee45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ab692d3b345188da00a83fe3019ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:02Z,use_quota=True,user_id='46a7108052aa4f2086525904878c63f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0cb8c35-807c-4f05-8ea1-5e540716e217),volume_type_id=a0cb8c35-807c-4f05-8ea1-5e540716e217)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595b9cf-bf5b-48ff-855b-a55a096e9942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595b9cf-bf5b-48ff-855b-a55a096e9942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e164f0e-602f-4c21-a1f3-dd8f81e82fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e164f0e-602f-4c21-a1f3-dd8f81e82fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feed66f2-cfb8-453c-97ae-82473191ee45', 'volume_name': 'volume-feed66f2-cfb8-453c-97ae-82473191ee45', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67003548-3f0d-4078-ae4f-325b857f07cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67003548-3f0d-4078-ae4f-325b857f07cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe8805f-5803-49c4-a4af-1e0b5bb3e946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:02 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Volume feed66f2-cfb8-453c-97ae-82473191ee45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feed66f2-cfb8-453c-97ae-82473191ee45', 'volume_size': 1} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b8d1ce5-6765-4a26-aa42-ec64a0963474,created_at=2026-09-10T18:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-411315554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b8d1ce5-6765-4a26-aa42-ec64a0963474,host='devstack@QuobyteHD#QuobyteHD',id=feed66f2-cfb8-453c-97ae-82473191ee45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5ab692d3b345188da00a83fe3019ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:02Z,use_quota=True,user_id='46a7108052aa4f2086525904878c63f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0cb8c35-807c-4f05-8ea1-5e540716e217),volume_type_id=a0cb8c35-807c-4f05-8ea1-5e540716e217)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Creating volume feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:08:02 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:08:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:02 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 1073741824 Sep 10 20:08:02 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:03 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 1073741824" returned: 0 in 1.064s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:03 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 Sep 10 20:08:03 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:04 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45" returned: 0 in 0.374s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:08:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe8805f-5803-49c4-a4af-1e0b5bb3e946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feed66f2-cfb8-453c-97ae-82473191ee45', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346716ce-27ab-4c6d-9145-170a498e4c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:04 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Volume volume-feed66f2-cfb8-453c-97ae-82473191ee45 (feed66f2-cfb8-453c-97ae-82473191ee45): created successfully Sep 10 20:08:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346716ce-27ab-4c6d-9145-170a498e4c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Flow 'volume_create_manager' (43f3d498-fac6-42b9-91a8-842fa6b1e55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:04 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f262b41c-8eb0-4e51-a258-c165fab5ee40 tempest-GroupsV314Test-133608659 None] Created volume successfully. Sep 10 20:08:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:06 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Cloning volume feed66f2-cfb8-453c-97ae-82473191ee45 to volume 6fb3a2cc-4afe-4800-8f26-cd42b25b23ff Sep 10 20:08:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Creating offline snapshot e0e9fc70-03d4-4d46-a983-6090ace587f1 of volume feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:08:06 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96fa368-41ed-441b-91df-65372d2be1e8]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:06 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 Sep 10 20:08:06 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:07 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45" returned: 0 in 0.755s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:07 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 1G Sep 10 20:08:07 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:07 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 1G" returned: 0 in 0.557s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feed66f2-cfb8-453c-97ae-82473191ee45 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:07 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feed66f2-cfb8-453c-97ae-82473191ee45 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 Sep 10 20:08:07 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:08 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feed66f2-cfb8-453c-97ae-82473191ee45 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1" returned: 0 in 0.433s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:08 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:08:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:08 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 Sep 10 20:08:08 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:08 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1" returned: 0 in 0.322s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:08 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.info Sep 10 20:08:08 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:08 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.info" returned: 0 in 0.272s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:08 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:08:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:08 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.info Sep 10 20:08:08 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:09 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.info" returned: 0 in 0.320s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Acquiring lock "cinder-quobyte-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Lock "cinder-quobyte-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] snapshot: e0e9fc70-03d4-4d46-a983-6090ace587f1, volume: 6fb3a2cc-4afe-4800-8f26-cd42b25b23ff, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a94432-c4cf-4c71-b101-84f2a3f1c080]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:09 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 Sep 10 20:08:09 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:09 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1" returned: 0 in 0.528s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feed66f2-cfb8-453c-97ae-82473191ee45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d7271-2ba8-49cb-8eb2-783f7446d0bc]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:09 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 Sep 10 20:08:09 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:10 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45" returned: 0 in 0.464s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:08:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:08:10 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:08:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:10 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff Sep 10 20:08:10 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:16 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" returned: 0 in 6.334s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:16 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:08:16 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Converted 1024.00 MB image at 161.64 MB/s Sep 10 20:08:16 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:08:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:16 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff Sep 10 20:08:16 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:16 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" returned: 0 in 0.373s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:16 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Lock "cinder-quobyte-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" released by "_copy_volume_from_snapshot" :: held 7.828s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:16 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Acquiring lock "cinder-quobyte-e0e9fc70-03d4-4d46-a983-6090ace587f1" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:16 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Lock "cinder-quobyte-e0e9fc70-03d4-4d46-a983-6090ace587f1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Deleting offline snapshot e0e9fc70-03d4-4d46-a983-6090ace587f1 of volume feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:08:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] snapshot_file for this snap is: volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:08:17 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49f7b2c-40da-486b-b1f9-c7f0c2bbd9f9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:17 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 Sep 10 20:08:17 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:17 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1" returned: 0 in 0.568s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feed66f2-cfb8-453c-97ae-82473191ee45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:08:17 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f02a94-c194-4390-ac37-3a62245e4e66]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:17 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 Sep 10 20:08:17 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:18 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:08:18 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45" returned: 0 in 0.843s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:18 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 Sep 10 20:08:18 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-497dac28-3a5b-43e3-9c2e-3701a37ac472 req-e6d30b73-b6d3-4f0d-9545-a1395a2e2f26 tempest-ServerActionsTestOtherA-528726344 None] Terminate volume connection completed successfully. Sep 10 20:08:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-497dac28-3a5b-43e3-9c2e-3701a37ac472 req-e6d30b73-b6d3-4f0d-9545-a1395a2e2f26 tempest-ServerActionsTestOtherA-528726344 None] Deleting attachment ad4d44ea-60c1-4bbc-a4a2-2b047631d2c0. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:08:19 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1" returned: 0 in 0.620s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:19 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1 Sep 10 20:08:19 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:19 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45.e0e9fc70-03d4-4d46-a983-6090ace587f1" returned: 0 in 0.372s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Lock "cinder-quobyte-e0e9fc70-03d4-4d46-a983-6090ace587f1" released by "_delete_snapshot" :: held 2.668s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.435s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f8044bb2-cce0-4105-866d-8cb35d09bfa8 tempest-GroupsV314Test-133608659 None] Create group from source-group-9b8d1ce5-6765-4a26-aa42-ec64a0963474 completed successfully. Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:20 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:08:20 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:20 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.404s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 8 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:08:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:08:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Acquiring lock "cinder-quobyte-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Lock "cinder-quobyte-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" acquired by "delete_volume" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:21 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa51918e-4371-486e-bb77-515fcb4ec660]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:21 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff Sep 10 20:08:21 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:21 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" returned: 0 in 0.523s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:21 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff Sep 10 20:08:21 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:22 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" returned: 0 in 0.375s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Lock "cinder-quobyte-6fb3a2cc-4afe-4800-8f26-cd42b25b23ff" released by "delete_volume" :: held 0.960s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Created reservations ['75a8a143-d4f1-463c-b463-dff0967ed785'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:22 devstack cinder-volume[88137]: WARNING cinder.quota [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1269924400 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1269924400, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:08:22 devstack cinder-volume[88137]: WARNING cinder.quota [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1269924400 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1269924400, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Created reservations ['711bfde9-0eb0-4dfe-8787-fb9247e02035', '94c8e916-9d79-43e1-98c6-7a6869c0b06f', 'd6c0fd8b-c9c7-42a7-96f0-7ba351dd95e9', '49f0c005-e504-4f33-afaa-4e69373b0a17'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:22 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:08:22 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:23 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.472s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:23 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:08:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-30ce3e0d-40e9-4cf6-bfa7-d4b5e73a30d9 tempest-GroupsV314Test-133608659 None] Delete group completed successfully. Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Flow 'volume_create_manager' (cb1cadf6-1aa5-4abe-ac62-96f4f148d830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9829406a-d5a7-43c1-82f2-113e8bcd7217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9829406a-d5a7-43c1-82f2-113e8bcd7217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1640564836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e21f6d-24cf-46b8-b5d3-997ea6154bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7f6733356e414f859b65f476361030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:24Z,use_quota=True,user_id='2a721f488ae448cf9163fbd9779749a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9922bc2f-830e-4e4a-be82-1b5ee50a72c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9922bc2f-830e-4e4a-be82-1b5ee50a72c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0534b3-ae36-40d9-b9bc-be990bc8ac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0534b3-ae36-40d9-b9bc-be990bc8ac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e21f6d-24cf-46b8-b5d3-997ea6154bd4', 'volume_name': 'volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897faadf-828b-4c98-b3ef-4a724f098b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897faadf-828b-4c98-b3ef-4a724f098b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cdbcbe-4d46-45ac-bbd0-e67f8d67f1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:24 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Volume c6e21f6d-24cf-46b8-b5d3-997ea6154bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4', 'volume_size': 1} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1640564836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e21f6d-24cf-46b8-b5d3-997ea6154bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7f6733356e414f859b65f476361030',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:24Z,use_quota=True,user_id='2a721f488ae448cf9163fbd9779749a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Creating volume c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:08:24 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:24 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 1073741824 Sep 10 20:08:24 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Acquiring lock "cinder-quobyte-feed66f2-cfb8-453c-97ae-82473191ee45" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Lock "cinder-quobyte-feed66f2-cfb8-453c-97ae-82473191ee45" acquired by "delete_volume" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc825025-6228-41df-84dc-d15aae7633c7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:24 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 Sep 10 20:08:24 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:25 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:25 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45" returned: 0 in 0.682s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 1073741824" returned: 0 in 0.905s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:25 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45 Sep 10 20:08:25 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:25 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 Sep 10 20:08:25 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:25 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-feed66f2-cfb8-453c-97ae-82473191ee45" returned: 0 in 0.318s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Lock "cinder-quobyte-feed66f2-cfb8-453c-97ae-82473191ee45" released by "delete_volume" :: held 1.111s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Created reservations ['028705b3-74a5-440b-81a4-e346afdc3b5d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Created reservations ['30bf6dda-31d5-4520-8d4c-bff937fa610a', 'f30d5e93-90ab-4d29-a4ad-8041573ec3b8', 'a748d0a2-da00-4852-aeb6-20d44a869230', 'a8b96828-1887-4694-956c-9e5556f9814c'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:25 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" returned: 0 in 0.643s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cdbcbe-4d46-45ac-bbd0-e67f8d67f1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d0662b-1994-4cd0-a54e-f013b0a27826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:26 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Volume volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 (c6e21f6d-24cf-46b8-b5d3-997ea6154bd4): created successfully Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d0662b-1994-4cd0-a54e-f013b0a27826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Flow 'volume_create_manager' (cb1cadf6-1aa5-4abe-ac62-96f4f148d830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:26 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-25be6d4e-c373-4fcf-b0d6-95a18a74b068 req-a86eda81-be5d-4661-8112-0dc302122b4e tempest-VolumesSnapshotsTestJSON-1032883490 None] Created volume successfully. Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:26 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:08:26 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:26 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.347s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:26 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:08:26 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-284af9f5-767d-4e82-bedb-a9dfa86f7351 tempest-GroupsV314Test-133608659 None] Delete group completed successfully. Sep 10 20:08:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Creating offline snapshot 32a08784-9e7a-40a8-bff7-c0815eca6d33 of volume c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:08:27 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d77c15-5f1d-4ef9-91c9-5fb95c34570f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:27 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 Sep 10 20:08:27 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:27 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" returned: 0 in 0.626s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:27 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 1G Sep 10 20:08:27 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:28 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 1G" returned: 0 in 0.671s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:28 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 Sep 10 20:08:28 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Flow 'volume_create_manager' (03040f34-230b-47dc-b53e-231ddfe7aec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de1eccd-8388-474b-a13f-a747f4021496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de1eccd-8388-474b-a13f-a747f4021496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2138983687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a0658f-62b7-477e-8f78-1fb5a015ff71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8bc15b5b5ce49e49ef36456336afdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:29Z,use_quota=True,user_id='782e0c5360b34ba495054dd63b670358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f69bde5-0e85-4c02-ada4-1fa10ffe567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f69bde5-0e85-4c02-ada4-1fa10ffe567e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964a094e-2a01-49f2-ae76-1bb8b96bb695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:28 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:08:29 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33" returned: 0 in 0.552s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:29 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 is being set with open permissions: ugo+rw Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:29 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 Sep 10 20:08:29 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:29 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33" returned: 0 in 0.382s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:29 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.info Sep 10 20:08:29 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:29 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.info" returned: 0 in 0.325s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:29 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.info is being set with open permissions: ugo+rw Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964a094e-2a01-49f2-ae76-1bb8b96bb695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85a0658f-62b7-477e-8f78-1fb5a015ff71', 'volume_name': 'volume-85a0658f-62b7-477e-8f78-1fb5a015ff71', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:29 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.info Sep 10 20:08:29 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8981b7-28c8-4ec2-adc8-34e908c739e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8981b7-28c8-4ec2-adc8-34e908c739e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900e9ca3-8093-4bb5-a12e-253f061e3b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:29 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Volume 85a0658f-62b7-477e-8f78-1fb5a015ff71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85a0658f-62b7-477e-8f78-1fb5a015ff71', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 20:08:29 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Trying to clone 85a0658f-62b7-477e-8f78-1fb5a015ff71 from image c78ee229-c276-4323-b914-d91a23a49bd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:08:30 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.info" returned: 0 in 0.327s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.058s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-e2c39091-0626-4303-9db7-f88dab959cd0 req-7f990758-02c7-4a9e-aec5-dd16acefbef4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Create snapshot completed successfully Sep 10 20:08:30 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:08:30 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Image download 20.69 MB at 20.69 MB/s Sep 10 20:08:30 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[212ce9e7-203a-45ed-903d-6692157f267f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:30 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD Sep 10 20:08:30 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:30 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:30 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 is fetched for user 782e0c5360b34ba495054dd63b670358. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:08:30 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[11736ef0-bed7-4215-86a5-d75768947b45]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Acquiring lock "cinder-32a08784-9e7a-40a8-bff7-c0815eca6d33-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:31 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD Sep 10 20:08:31 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-32a08784-9e7a-40a8-bff7-c0815eca6d33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Acquiring lock "cinder-quobyte-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-quobyte-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Acquiring lock "cinder-quobyte-32a08784-9e7a-40a8-bff7-c0815eca6d33" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-quobyte-32a08784-9e7a-40a8-bff7-c0815eca6d33" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Deleting offline snapshot 32a08784-9e7a-40a8-bff7-c0815eca6d33 of volume c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] snapshot_file for this snap is: volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bc3865-f17b-4bf4-bc92-1f31d21eaf9e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:31 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 Sep 10 20:08:31 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:31 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2138983687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a0658f-62b7-477e-8f78-1fb5a015ff71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8bc15b5b5ce49e49ef36456336afdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:29Z,use_quota=True,user_id='782e0c5360b34ba495054dd63b670358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Creating volume 85a0658f-62b7-477e-8f78-1fb5a015ff71 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:08:31 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:31 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 1073741824 Sep 10 20:08:31 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:31 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33" returned: 0 in 0.540s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fc96dc-48b3-4629-be46-f1d4455b377d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:31 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 Sep 10 20:08:31 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:31 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 1073741824" returned: 0 in 0.563s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:32 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 Sep 10 20:08:32 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:32 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" returned: 0 in 0.484s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:32 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 Sep 10 20:08:32 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:32 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71" returned: 0 in 0.368s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Attempting download of c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume 85a0658f-62b7-477e-8f78-1fb5a015ff71. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc88178-a546-467f-b28f-78270df80f6f]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_b6ekbsi2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:32 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_b6ekbsi2 Sep 10 20:08:32 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:32 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33" returned: 0 in 0.406s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:32 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33 Sep 10 20:08:32 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:32 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_b6ekbsi2" returned: 0 in 0.390s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_b6ekbsi2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:33 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_b6ekbsi2 Sep 10 20:08:33 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:33 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4.32a08784-9e7a-40a8-bff7-c0815eca6d33" returned: 0 in 0.382s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-quobyte-32a08784-9e7a-40a8-bff7-c0815eca6d33" released by "_delete_snapshot" :: held 1.967s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-quobyte-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" released by "delete_snapshot" :: held 2.010s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:33 devstack cinder-volume[88137]: WARNING cinder.quota [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG cinder.quota [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Created reservations ['153cea5b-fb8c-4bbb-a490-0bc03484582f', 'ab9f0910-b8d2-4f90-bb2b-786d4c63ecc3', '8449aca9-138d-4517-b235-0fd84416443b', '75079115-6f78-4057-8489-d81605368a2d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:33 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_b6ekbsi2" returned: 1 in 0.400s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_b6ekbsi2' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2216b5-4ed1-4d46-8806-206f41a318e9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Delete snapshot completed successfully. Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-89cd0286-a4cf-4acb-b7b9-9f989b5c6676 req-e7af5760-3048-4493-a5ae-9d1f61ceadf7 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-32a08784-9e7a-40a8-bff7-c0815eca6d33-delete_snapshot" released by "delete_snapshot" :: held 2.254s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Acquiring lock "cinder-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:33 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD Sep 10 20:08:33 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Acquiring lock "cinder-quobyte-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-quobyte-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" acquired by "delete_volume" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ffa698-eee6-48df-a996-a902103fbfec]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:33 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] c78ee229-c276-4323-b914-d91a23a49bd6 was qcow2, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:08:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:33 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 Sep 10 20:08:33 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:33 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 Sep 10 20:08:33 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:34 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" returned: 0 in 0.524s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:34 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4 Sep 10 20:08:34 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:34 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" returned: 0 in 0.343s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-quobyte-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4" released by "delete_volume" :: held 0.951s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG cinder.quota [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Created reservations ['680c2cd0-f6ec-41a2-b331-3dfda0320df6', '13f871a0-1d45-4ef5-a556-29befede1d85', '84c1411d-6c76-4f70-8590-1798ae58593d', '5e7543bc-0844-43db-94cf-18a4f0afa399'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:34 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:08:34 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:35 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.394s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:35 devstack cinder-volume[88137]: DEBUG cinder.manager [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:08:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Deleted volume successfully. Sep 10 20:08:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-6c84dd45-1f8d-4536-b42d-1e5b9ac84691 req-0fcabe38-622d-479f-910f-ae98eb8f92a4 tempest-VolumesSnapshotsTestJSON-1032883490 None] Lock "cinder-c6e21f6d-24cf-46b8-b5d3-997ea6154bd4-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:35 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71" returned: 0 in 2.174s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:35 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_5isuv7dudevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:08:35 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Converted 112.00 MB image at 51.49 MB/s Sep 10 20:08:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:35 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 1G Sep 10 20:08:35 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:36 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 1G" returned: 0 in 0.442s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Downloaded image c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume 85a0658f-62b7-477e-8f78-1fb5a015ff71 successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 for user 782e0c5360b34ba495054dd63b670358 is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Marking volume 85a0658f-62b7-477e-8f78-1fb5a015ff71 as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Copying metadata from image c78ee229-c276-4323-b914-d91a23a49bd6 to 85a0658f-62b7-477e-8f78-1fb5a015ff71. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Creating volume glance metadata for volume 85a0658f-62b7-477e-8f78-1fb5a015ff71 backed by image c78ee229-c276-4323-b914-d91a23a49bd6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900e9ca3-8093-4bb5-a12e-253f061e3b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a0658f-62b7-477e-8f78-1fb5a015ff71', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85444f4-fcdc-4741-9fb8-9c83e11c9cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:36 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Volume volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 (85a0658f-62b7-477e-8f78-1fb5a015ff71): created successfully Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85444f4-fcdc-4741-9fb8-9c83e11c9cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Flow 'volume_create_manager' (03040f34-230b-47dc-b53e-231ddfe7aec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ca1d7c8c-eec1-4280-ab8b-1263f7afe8c3 tempest-ServerActionsTestOtherA-528726344 None] Created volume successfully. Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Flow 'volume_create_manager' (7745836c-4f0b-43ca-9fb8-331c646e8ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02092d30-8dc2-4b7d-b669-3ca9fb4303bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02092d30-8dc2-4b7d-b669-3ca9fb4303bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-421464985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e364160-9240-4151-9f37-f73f211c0a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3682469aa246c58b0fa8cd388f2a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:37Z,use_quota=True,user_id='88558c0aec2541948588dad706dee707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5866a8-fef3-4f4c-8d06-0997c4fb6740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5866a8-fef3-4f4c-8d06-0997c4fb6740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abde8a4-0412-4814-b77d-182df7597ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abde8a4-0412-4814-b77d-182df7597ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e364160-9240-4151-9f37-f73f211c0a2e', 'volume_name': 'volume-5e364160-9240-4151-9f37-f73f211c0a2e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22122028-0523-4dbf-ac5b-c266fa05503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22122028-0523-4dbf-ac5b-c266fa05503a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58822b2a-2bec-490c-85bf-bfdaabc6cafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:37 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Volume 5e364160-9240-4151-9f37-f73f211c0a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e364160-9240-4151-9f37-f73f211c0a2e', 'volume_size': 1} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-421464985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e364160-9240-4151-9f37-f73f211c0a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3682469aa246c58b0fa8cd388f2a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:37Z,use_quota=True,user_id='88558c0aec2541948588dad706dee707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Creating volume 5e364160-9240-4151-9f37-f73f211c0a2e {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:08:37 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:08:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:37 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e 1073741824 Sep 10 20:08:37 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:38 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e 1073741824" returned: 0 in 0.661s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:38 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e Sep 10 20:08:38 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:38 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e" returned: 0 in 0.292s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:08:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58822b2a-2bec-490c-85bf-bfdaabc6cafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e364160-9240-4151-9f37-f73f211c0a2e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3645690a-f069-4bf2-a2fa-6682c5cf108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:38 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Volume volume-5e364160-9240-4151-9f37-f73f211c0a2e (5e364160-9240-4151-9f37-f73f211c0a2e): created successfully Sep 10 20:08:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3645690a-f069-4bf2-a2fa-6682c5cf108b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Flow 'volume_create_manager' (7745836c-4f0b-43ca-9fb8-331c646e8ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-01cfff4f-c995-44c5-8dcf-85c4f709a8fc tempest-VolumeQuotasAdminTestJSON-1576513600 None] Created volume successfully. Sep 10 20:08:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Acquiring lock "cinder-5e364160-9240-4151-9f37-f73f211c0a2e-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "cinder-5e364160-9240-4151-9f37-f73f211c0a2e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Acquiring lock "cinder-quobyte-5e364160-9240-4151-9f37-f73f211c0a2e" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "cinder-quobyte-5e364160-9240-4151-9f37-f73f211c0a2e" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6942e791-a55f-4755-b688-1a5ed2a2478a]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:39 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e Sep 10 20:08:39 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:40 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e" returned: 0 in 0.575s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:40 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e Sep 10 20:08:40 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:40 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e364160-9240-4151-9f37-f73f211c0a2e" returned: 0 in 0.324s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "cinder-quobyte-5e364160-9240-4151-9f37-f73f211c0a2e" released by "delete_volume" :: held 0.970s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-2979fed7-4d86-4a30-8109-a13e16170c02 req-06fa0dd0-bbb9-4ce4-a2dd-99a5ed719bc8 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-2979fed7-4d86-4a30-8109-a13e16170c02 req-06fa0dd0-bbb9-4ce4-a2dd-99a5ed719bc8 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-2979fed7-4d86-4a30-8109-a13e16170c02 req-06fa0dd0-bbb9-4ce4-a2dd-99a5ed719bc8 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Created reservations ['b1a9053b-a321-4111-94dd-ed7965ed08ab', 'f23927a4-0bf8-4aab-bb8a-d4a79b4dfa46', '3f9a3d92-360f-4cf4-a928-a023d7e9e734', 'd9981cf6-f0ee-47e1-8a28-c6f9e42fcdd4'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-2979fed7-4d86-4a30-8109-a13e16170c02 req-06fa0dd0-bbb9-4ce4-a2dd-99a5ed719bc8 tempest-ServerActionsTestOtherA-528726344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-85a0658f-62b7-477e-8f78-1fb5a015ff71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59b2ae2f-d20f-47fa-80e0-477b54ad4d8c', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:40 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:08:40 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:40 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-2979fed7-4d86-4a30-8109-a13e16170c02 req-06fa0dd0-bbb9-4ce4-a2dd-99a5ed719bc8 tempest-ServerActionsTestOtherA-528726344 None] attachment_update completed successfully. Sep 10 20:08:41 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.418s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:08:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Deleted volume successfully. Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-72e06b64-0ff9-46ff-a70f-963f7348be40 tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "cinder-5e364160-9240-4151-9f37-f73f211c0a2e-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Flow 'volume_create_manager' (318cb5e7-7c06-407e-824f-776bf4a31809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c9c1a8-b32f-4c5a-9ca3-20e8d5ae778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c9c1a8-b32f-4c5a-9ca3-20e8d5ae778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-642411492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdc0a70-2b85-4116-b898-aa83aab437e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcbc60d04d994eb1b8ea5a8910ae5edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:42Z,use_quota=True,user_id='d973060a57834a67bd9faac43fec7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6719cf-ef5c-4b50-a26d-f1f1e2bdc598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6719cf-ef5c-4b50-a26d-f1f1e2bdc598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4313a7-40ed-4a2c-b137-8ab4978928a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4313a7-40ed-4a2c-b137-8ab4978928a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bdc0a70-2b85-4116-b898-aa83aab437e7', 'volume_name': 'volume-9bdc0a70-2b85-4116-b898-aa83aab437e7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6383494-7dfb-4463-8ca0-e73fee2808a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6383494-7dfb-4463-8ca0-e73fee2808a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a23daf-fc68-4337-aca7-75decb14e1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:41 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Volume 9bdc0a70-2b85-4116-b898-aa83aab437e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bdc0a70-2b85-4116-b898-aa83aab437e7', 'volume_size': 1} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-642411492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdc0a70-2b85-4116-b898-aa83aab437e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcbc60d04d994eb1b8ea5a8910ae5edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:42Z,use_quota=True,user_id='d973060a57834a67bd9faac43fec7709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Creating volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:08:41 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:08:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:41 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 1073741824 Sep 10 20:08:41 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Flow 'volume_create_manager' (ed2f1933-8d6b-4f91-a0de-0b6981ee94f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8166c091-5cda-4c33-8868-062cafc5257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:42 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 1073741824" returned: 0 in 0.620s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8166c091-5cda-4c33-8868-062cafc5257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-295104872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03291b92-3710-4772-ac56-244535685fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3682469aa246c58b0fa8cd388f2a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:42Z,use_quota=True,user_id='88558c0aec2541948588dad706dee707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f700effb-f2fd-4d86-994d-3e425bc6a7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f700effb-f2fd-4d86-994d-3e425bc6a7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8ef880-a2b8-4a78-ae30-646c580170eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8ef880-a2b8-4a78-ae30-646c580170eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03291b92-3710-4772-ac56-244535685fe4', 'volume_name': 'volume-03291b92-3710-4772-ac56-244535685fe4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0443e367-ac52-4ef6-bdcb-6af358f86bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0443e367-ac52-4ef6-bdcb-6af358f86bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc903f87-cd30-4704-afe3-380c26b7f2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:42 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Volume 03291b92-3710-4772-ac56-244535685fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03291b92-3710-4772-ac56-244535685fe4', 'volume_size': 1} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:42 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 Sep 10 20:08:42 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:42 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7" returned: 0 in 0.246s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-295104872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03291b92-3710-4772-ac56-244535685fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3682469aa246c58b0fa8cd388f2a24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:42Z,use_quota=True,user_id='88558c0aec2541948588dad706dee707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Creating volume 03291b92-3710-4772-ac56-244535685fe4 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:08:42 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a23daf-fc68-4337-aca7-75decb14e1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bdc0a70-2b85-4116-b898-aa83aab437e7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454a7496-d04f-4546-ba12-de7bfbd9be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:42 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4 1073741824 Sep 10 20:08:42 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:42 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Volume volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 (9bdc0a70-2b85-4116-b898-aa83aab437e7): created successfully Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454a7496-d04f-4546-ba12-de7bfbd9be5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Flow 'volume_create_manager' (318cb5e7-7c06-407e-824f-776bf4a31809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:42 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-45f063ae-b753-4424-b60a-23f4bc495169 tempest-SnapshotsActionsTest-2042901133 None] Created volume successfully. Sep 10 20:08:43 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4 1073741824" returned: 0 in 0.610s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:43 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4 Sep 10 20:08:43 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:43 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4" returned: 0 in 0.414s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:08:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc903f87-cd30-4704-afe3-380c26b7f2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03291b92-3710-4772-ac56-244535685fe4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c9f53f-8d3f-4924-bdee-64c71cba8332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:43 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Volume volume-03291b92-3710-4772-ac56-244535685fe4 (03291b92-3710-4772-ac56-244535685fe4): created successfully Sep 10 20:08:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c9f53f-8d3f-4924-bdee-64c71cba8332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Flow 'volume_create_manager' (ed2f1933-8d6b-4f91-a0de-0b6981ee94f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:43 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8bd8303e-673f-4456-9972-6080ae707b0e tempest-VolumeQuotasAdminTestJSON-1576513600 None] Created volume successfully. Sep 10 20:08:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Creating offline snapshot 72465937-253a-4aa0-af99-cafce460a55d of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:08:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bdf526-7cb2-4d50-a91e-b3a89b605f35]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:44 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 Sep 10 20:08:44 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:44 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7" returned: 0 in 0.524s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:44 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d 1G Sep 10 20:08:44 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:45 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d 1G" returned: 0 in 0.749s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:45 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:08:45 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:45 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b4c927b4-102a-42cf-abf8-fd9bde77d4d8 tempest-VolumeQuotasAdminTestJSON-1850902915 None] Transfer volume completed successfully. Sep 10 20:08:46 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.600s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:46 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d is being set with open permissions: ugo+rw Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:46 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:08:46 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:46 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.416s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Acquiring lock "cinder-03291b92-3710-4772-ac56-244535685fe4-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Lock "cinder-03291b92-3710-4772-ac56-244535685fe4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:46 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.info Sep 10 20:08:46 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Acquiring lock "cinder-quobyte-03291b92-3710-4772-ac56-244535685fe4" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Lock "cinder-quobyte-03291b92-3710-4772-ac56-244535685fe4" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcea6a82-1885-4ba3-997c-0e59b586075f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:46 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4 Sep 10 20:08:46 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:46 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.info" returned: 0 in 0.386s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:46 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.info is being set with open permissions: ugo+rw Sep 10 20:08:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:47 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.info Sep 10 20:08:47 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:47 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4" returned: 0 in 0.459s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:47 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4 Sep 10 20:08:47 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:47 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.info" returned: 0 in 0.385s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.263s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:47 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0797d040-7634-4e32-8374-76dceb6bffd7 tempest-SnapshotsActionsTest-2042901133 None] Create snapshot completed successfully Sep 10 20:08:47 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-03291b92-3710-4772-ac56-244535685fe4" returned: 0 in 0.399s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Lock "cinder-quobyte-03291b92-3710-4772-ac56-244535685fe4" released by "delete_volume" :: held 0.916s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Created reservations ['e8b125fa-fc3e-43af-9e02-fa766d3cffa3', 'ee55f997-5dad-433c-ba97-5335aeba28fd', '8260c421-2eda-4834-b6b9-c6d68f3b2ffd', 'd691caf8-08a8-4c2f-8542-0aa2277fffb6'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:47 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:08:47 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:48 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.597s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:48 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:08:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Deleted volume successfully. Sep 10 20:08:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c441b42-6016-496d-aa23-9e4f71ee35f8 tempest-VolumeQuotasAdminTestJSON-23330064 None] Lock "cinder-03291b92-3710-4772-ac56-244535685fe4-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Flow 'volume_create_manager' (93a91d24-2898-4ca2-afbe-f07e4f085b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ad6f18-0c46-4813-9894-54985dd8b9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ad6f18-0c46-4813-9894-54985dd8b9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1218856632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd9cb32-336f-4c9f-866e-d37c6b5787d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df8fcdb137541d184dd27b7b2ca6e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:49Z,use_quota=True,user_id='5aca07c5bf034367b9a17ddececbabae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1594da15-8c02-40c1-89a3-5f58fa8d22a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1594da15-8c02-40c1-89a3-5f58fa8d22a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4762c9f-6208-4dae-aa78-6c98130dbaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4762c9f-6208-4dae-aa78-6c98130dbaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd9cb32-336f-4c9f-866e-d37c6b5787d6', 'volume_name': 'volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8560b79e-10e2-4eea-b1ed-a92ee6323951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8560b79e-10e2-4eea-b1ed-a92ee6323951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea8336d-94cc-4faa-84d4-c3045c254222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:49 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Volume fdd9cb32-336f-4c9f-866e-d37c6b5787d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6', 'volume_size': 1} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1218856632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd9cb32-336f-4c9f-866e-d37c6b5787d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df8fcdb137541d184dd27b7b2ca6e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:08:49Z,use_quota=True,user_id='5aca07c5bf034367b9a17ddececbabae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Creating volume fdd9cb32-336f-4c9f-866e-d37c6b5787d6 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:08:49 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:49 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 1073741824 Sep 10 20:08:49 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:50 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 1073741824" returned: 0 in 0.968s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:50 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 Sep 10 20:08:50 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:50 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6" returned: 0 in 0.567s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:08:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.209s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea8336d-94cc-4faa-84d4-c3045c254222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb530bc-1231-4579-b59c-cd9bd2b18ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Creating offline snapshot b23e27ab-38be-4d7d-b841-4420ce02a7cd of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8080e98e-d9af-4f83-9386-72253a445b03]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Volume volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 (fdd9cb32-336f-4c9f-866e-d37c6b5787d6): created successfully Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb530bc-1231-4579-b59c-cd9bd2b18ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Flow 'volume_create_manager' (93a91d24-2898-4ca2-afbe-f07e4f085b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:08:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9b86d04d-da5e-4f1a-86e7-40a1530ac7ff tempest-AttachVolumeShelveTestJSON-4752798 None] Created volume successfully. Sep 10 20:08:51 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:08:51 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:51 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.790s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:08:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:51 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd 1G Sep 10 20:08:51 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:52 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd 1G" returned: 0 in 0.777s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:52 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd Sep 10 20:08:52 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:53 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd" returned: 0 in 0.540s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:53 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd is being set with open permissions: ugo+rw Sep 10 20:08:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:53 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd Sep 10 20:08:53 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:53 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd" returned: 0 in 0.320s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:08:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d517edec-5839-4d80-8eab-50547b20d819 tempest-SnapshotsActionsTest-2042901133 None] Create snapshot completed successfully Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-b23e27ab-38be-4d7d-b841-4420ce02a7cd-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-b23e27ab-38be-4d7d-b841-4420ce02a7cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-quobyte-b23e27ab-38be-4d7d-b841-4420ce02a7cd" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-b23e27ab-38be-4d7d-b841-4420ce02a7cd" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Deleting offline snapshot b23e27ab-38be-4d7d-b841-4420ce02a7cd of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] snapshot_file for this snap is: volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4f7b94-39ee-4322-be03-f207fc0f9cf3]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:54 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd Sep 10 20:08:54 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:55 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd" returned: 0 in 0.970s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:08:55 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7b05a6-08b5-440a-bd5f-02c3a37ef77f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:55 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:08:55 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:56 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.568s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:08:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:56 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd Sep 10 20:08:56 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:56 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd" returned: 0 in 0.828s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:57 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd Sep 10 20:08:57 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:08:57 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 10 20:08:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.b23e27ab-38be-4d7d-b841-4420ce02a7cd" returned: 0 in 0.460s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:08:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-b23e27ab-38be-4d7d-b841-4420ce02a7cd" released by "_delete_snapshot" :: held 3.008s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" released by "delete_snapshot" :: held 3.058s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=92,cinder:UPDATE=92,cinder:INSERT=23,cinder:DELETE=5 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:08:57 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Created reservations ['fa1d1a5a-9728-4c68-abed-b50d75fa0046', '8e0ca6e1-4a42-4233-ab15-a70f98cfa34b', '509ad1d0-b592-45d4-9897-1c8d258eafc7', '2b76ebf7-c514-47c2-9c0d-3f094cae535a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:08:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Delete snapshot completed successfully. Sep 10 20:08:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9d7915e3-c6a7-4d1d-b26a-ccaaaf11c996 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-b23e27ab-38be-4d7d-b841-4420ce02a7cd-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:08:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-6e0a238d-a05a-4601-8668-64255f72a2ea req-041a7043-232b-45ae-a065-901a12f93d95 tempest-ServerActionsTestOtherA-528726344 None] Terminate volume connection completed successfully. Sep 10 20:08:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-6e0a238d-a05a-4601-8668-64255f72a2ea req-041a7043-232b-45ae-a065-901a12f93d95 tempest-ServerActionsTestOtherA-528726344 None] Deleting attachment 59b2ae2f-d20f-47fa-80e0-477b54ad4d8c. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:08:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:08:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:08:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Creating offline snapshot f48f3ded-286a-4c82-9124-7a2bc637f7fd of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:08:59 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ef4ea7-6648-4b0c-a06a-50b8e899da70]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:08:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:08:59 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:08:59 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:00 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.485s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:00 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd 1G Sep 10 20:09:00 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:00 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd 1G" returned: 0 in 0.660s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:00 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd Sep 10 20:09:00 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-6e0a238d-a05a-4601-8668-64255f72a2ea req-1879de6d-b2c4-4361-bf82-baebf74515e7 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:01 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd" returned: 0 in 0.345s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:01 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd is being set with open permissions: ugo+rw Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:01 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd Sep 10 20:09:01 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:01 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd" returned: 0 in 0.282s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-6e0a238d-a05a-4601-8668-64255f72a2ea req-1879de6d-b2c4-4361-bf82-baebf74515e7 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.593s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-6e0a238d-a05a-4601-8668-64255f72a2ea req-1879de6d-b2c4-4361-bf82-baebf74515e7 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a73e862e-4fd8-4317-b881-a5620df8f87e tempest-SnapshotsActionsTest-2042901133 None] Create snapshot completed successfully Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-6e0a238d-a05a-4601-8668-64255f72a2ea req-1879de6d-b2c4-4361-bf82-baebf74515e7 tempest-ServerActionsTestOtherA-528726344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-85a0658f-62b7-477e-8f78-1fb5a015ff71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01640cb4-110c-4ffb-afa6-bfaa151c3214', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:09:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-6e0a238d-a05a-4601-8668-64255f72a2ea req-1879de6d-b2c4-4361-bf82-baebf74515e7 tempest-ServerActionsTestOtherA-528726344 None] attachment_update completed successfully. Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-f48f3ded-286a-4c82-9124-7a2bc637f7fd-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-f48f3ded-286a-4c82-9124-7a2bc637f7fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-quobyte-f48f3ded-286a-4c82-9124-7a2bc637f7fd" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-f48f3ded-286a-4c82-9124-7a2bc637f7fd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Deleting offline snapshot f48f3ded-286a-4c82-9124-7a2bc637f7fd of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:09:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] snapshot_file for this snap is: volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:09:02 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b8728e-de96-41e4-8462-e9779367a60d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:02 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd Sep 10 20:09:02 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:02 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd" returned: 0 in 0.823s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:02 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad083d6-d9f7-4234-a163-1ce0a96823cf]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:03 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:09:03 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Flow 'volume_create_manager' (e1350303-c772-40a0-8721-fecdcfac39ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8278a07-2828-46f2-815b-5609cd967df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8278a07-2828-46f2-815b-5609cd967df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1768613450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e03199-8cd1-4341-8984-74daae1a60cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b863511b6d547389ac13926afd7d4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:09:03Z,use_quota=True,user_id='c3ba9e710a234616b073d49d7b401cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b461732-d3c2-4600-a591-e3a9dd6126f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b461732-d3c2-4600-a591-e3a9dd6126f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e7815c-be51-483a-b273-3fab39bbffe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e7815c-be51-483a-b273-3fab39bbffe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e03199-8cd1-4341-8984-74daae1a60cc', 'volume_name': 'volume-02e03199-8cd1-4341-8984-74daae1a60cc', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4cd4f7-36f5-4ca7-a9b2-84ddad6b0bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4cd4f7-36f5-4ca7-a9b2-84ddad6b0bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5459c1-8f08-4d56-8f60-b1a0181ac966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:03 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Volume 02e03199-8cd1-4341-8984-74daae1a60cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e03199-8cd1-4341-8984-74daae1a60cc', 'volume_size': 1} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1768613450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e03199-8cd1-4341-8984-74daae1a60cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b863511b6d547389ac13926afd7d4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:09:03Z,use_quota=True,user_id='c3ba9e710a234616b073d49d7b401cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Creating volume 02e03199-8cd1-4341-8984-74daae1a60cc {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:09:03 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:03 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc 1073741824 Sep 10 20:09:03 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:03 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.649s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:03 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd Sep 10 20:09:03 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:04 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc 1073741824" returned: 0 in 0.904s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:04 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc Sep 10 20:09:04 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:04 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd" returned: 0 in 0.836s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:04 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd Sep 10 20:09:04 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:04 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc" returned: 0 in 0.500s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:09:04 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f48f3ded-286a-4c82-9124-7a2bc637f7fd" returned: 0 in 0.430s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-f48f3ded-286a-4c82-9124-7a2bc637f7fd" released by "_delete_snapshot" :: held 2.968s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5459c1-8f08-4d56-8f60-b1a0181ac966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e03199-8cd1-4341-8984-74daae1a60cc', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12905fa9-9d61-4f04-b910-5c5864ec3485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" released by "delete_snapshot" :: held 3.020s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:05 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Volume volume-02e03199-8cd1-4341-8984-74daae1a60cc (02e03199-8cd1-4341-8984-74daae1a60cc): created successfully Sep 10 20:09:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12905fa9-9d61-4f04-b910-5c5864ec3485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Flow 'volume_create_manager' (e1350303-c772-40a0-8721-fecdcfac39ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:09:05 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-089707df-b752-4482-bd20-dc743f573374 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Created volume successfully. Sep 10 20:09:05 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Created reservations ['07ed5b7f-73e6-4df3-b6cc-dde4b7a7cdf1', '081c1ce3-7339-4858-90f0-17e627bb9e23', '6d356e1a-7d82-4d80-938a-fd9073c847e0', '3b567be4-d802-40de-a57f-e7ec2eac0987'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:05 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Delete snapshot completed successfully. Sep 10 20:09:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8235a881-08f4-4685-bb3a-e3dca7c2fdc9 tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-f48f3ded-286a-4c82-9124-7a2bc637f7fd-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25762be1-5495-4d2c-be82-52da324c2273 req-d7cc8ea7-9914-4cfc-be27-b4680a70ce10 tempest-AttachVolumeShelveTestJSON-4752798 None] No connector for attachment 74173122-470b-4a06-9734-4180b4fec878; skipping storage backend terminate_connection call. {{(pid=88137) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 10 20:09:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-25762be1-5495-4d2c-be82-52da324c2273 req-d7cc8ea7-9914-4cfc-be27-b4680a70ce10 tempest-AttachVolumeShelveTestJSON-4752798 None] Deleting attachment 74173122-470b-4a06-9734-4180b4fec878. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:09:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Acquiring lock "cinder-02e03199-8cd1-4341-8984-74daae1a60cc-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "cinder-02e03199-8cd1-4341-8984-74daae1a60cc-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Acquiring lock "cinder-quobyte-02e03199-8cd1-4341-8984-74daae1a60cc" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Creating offline snapshot f50f8b1b-15b8-4045-9aae-74ac640f0fb5 of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "cinder-quobyte-02e03199-8cd1-4341-8984-74daae1a60cc" acquired by "delete_volume" :: waited 0.110s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc02c237-2c02-472f-a064-9ebe4f8e8ea4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a0f3d0-fc88-4ef5-92d0-7e511765b266]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:07 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:09:07 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:07 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc Sep 10 20:09:07 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:07 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.620s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:07 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 1G Sep 10 20:09:07 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:08 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc" returned: 0 in 0.745s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:08 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc Sep 10 20:09:08 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:08 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-02e03199-8cd1-4341-8984-74daae1a60cc" returned: 0 in 0.373s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "cinder-quobyte-02e03199-8cd1-4341-8984-74daae1a60cc" released by "delete_volume" :: held 1.204s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Created reservations ['6ddee8e2-76ee-4656-9f86-22d251e7599d', 'c7c98377-a2d5-43c5-b3de-754264a23c0a', 'a247108d-b247-43b5-8d39-91120ff9eb82', '7cefdb59-cfdc-4124-bc64-2da504e2ea89'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:08 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:08 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:08 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 1G" returned: 0 in 1.006s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:08 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 Sep 10 20:09:08 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:09 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.691s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:09 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:09 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Deleted volume successfully. Sep 10 20:09:09 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5" returned: 0 in 0.587s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:09 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 is being set with open permissions: ugo+rw Sep 10 20:09:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da33dc4-97c6-49a1-b68f-cddfef2e8195 tempest-VolumeQuotasNegativeTestJSON-38157161 None] Lock "cinder-02e03199-8cd1-4341-8984-74daae1a60cc-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:09 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 Sep 10 20:09:09 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:09 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5" returned: 0 in 0.406s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:09 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8cb40cbf-05b4-40b8-8aed-849ddf9a0c97 tempest-SnapshotsActionsTest-2042901133 None] Create snapshot completed successfully Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-f50f8b1b-15b8-4045-9aae-74ac640f0fb5-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-f50f8b1b-15b8-4045-9aae-74ac640f0fb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-quobyte-f50f8b1b-15b8-4045-9aae-74ac640f0fb5" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-f50f8b1b-15b8-4045-9aae-74ac640f0fb5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Deleting offline snapshot f50f8b1b-15b8-4045-9aae-74ac640f0fb5 of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] snapshot_file for this snap is: volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[592983d0-6716-453b-b830-8640116fed3b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:10 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 Sep 10 20:09:10 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:11 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5" returned: 0 in 0.552s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:11 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd6289c-b58d-4cbb-a988-970162823bc7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:11 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:09:11 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:11 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.565s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:11 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 Sep 10 20:09:11 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:12 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5" returned: 0 in 0.570s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:12 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5 Sep 10 20:09:12 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:12 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.f50f8b1b-15b8-4045-9aae-74ac640f0fb5" returned: 0 in 0.358s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-f50f8b1b-15b8-4045-9aae-74ac640f0fb5" released by "_delete_snapshot" :: held 2.184s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" released by "delete_snapshot" :: held 2.229s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:12 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Created reservations ['f011a86a-dcf5-400e-8b50-8932ea9fb1a1', 'fd13556e-5676-43f9-9564-6db17232afaa', 'cc17851b-2a20-4ede-b15c-87a953d70458', 'e6886b11-8702-40a5-b6f2-f515ffafb2c8'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:13 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Delete snapshot completed successfully. Sep 10 20:09:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-139d5372-da0a-49da-80aa-d1bb0ed52b9f tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-f50f8b1b-15b8-4045-9aae-74ac640f0fb5-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Creating offline snapshot c00e07a6-db25-411b-b162-e7af6c099941 of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:09:14 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34addb3-db43-4af2-8a3a-0e8ac64cfa3b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:14 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:09:14 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:15 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.634s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:15 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 1G Sep 10 20:09:15 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:15 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 1G" returned: 0 in 0.727s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:16 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 Sep 10 20:09:16 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:16 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941" returned: 0 in 0.350s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:16 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 is being set with open permissions: ugo+rw Sep 10 20:09:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:16 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 Sep 10 20:09:16 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:16 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941" returned: 0 in 0.385s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:16 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-09821cd1-ebf4-46d1-93ed-c677b3d1c168 tempest-SnapshotsActionsTest-2042901133 None] Create snapshot completed successfully Sep 10 20:09:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-c00e07a6-db25-411b-b162-e7af6c099941-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-c00e07a6-db25-411b-b162-e7af6c099941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Acquiring lock "cinder-quobyte-c00e07a6-db25-411b-b162-e7af6c099941" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-c00e07a6-db25-411b-b162-e7af6c099941" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Deleting offline snapshot c00e07a6-db25-411b-b162-e7af6c099941 of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:09:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] snapshot_file for this snap is: volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:09:18 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[78145f9c-9d19-4ea1-ab06-750dfd8b15d4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:18 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 Sep 10 20:09:18 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:18 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941" returned: 0 in 0.528s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:18 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51e4f26-5eb5-4584-bca6-4d0a0d6e2e8c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:18 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:09:18 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:19 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.864s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:19 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 Sep 10 20:09:19 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Flow 'volume_create_manager' (cdd63d1e-7497-44db-b10d-1731c182ba4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd465ac3-21a9-476c-9aae-41994b970c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=111,cinder:UPDATE=115,cinder:INSERT=34,cinder:DELETE=10 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd465ac3-21a9-476c-9aae-41994b970c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-722445125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043d5afb-9347-4e99-a44a-a5abff6b85ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61436389bbbe416d8c0b5326aab9222a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:09:20Z,use_quota=True,user_id='28efb816b29649c8a4d33ecb3beb8da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab70621e-256b-488d-9094-02a9359bbc7c),volume_type_id=ab70621e-256b-488d-9094-02a9359bbc7c)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd6eaa2-7c24-4e76-a3ca-d9afad8e5503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd6eaa2-7c24-4e76-a3ca-d9afad8e5503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b0cdf6-bd21-4120-ac87-5f02cfeba1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b0cdf6-bd21-4120-ac87-5f02cfeba1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '043d5afb-9347-4e99-a44a-a5abff6b85ed', 'volume_name': 'volume-043d5afb-9347-4e99-a44a-a5abff6b85ed', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b00c84c-a45c-4003-bf72-1e136296f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b00c84c-a45c-4003-bf72-1e136296f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7866ee7-b65a-449c-a9dc-b8a35ad201b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Volume 043d5afb-9347-4e99-a44a-a5abff6b85ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-043d5afb-9347-4e99-a44a-a5abff6b85ed', 'volume_size': 1} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-722445125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043d5afb-9347-4e99-a44a-a5abff6b85ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61436389bbbe416d8c0b5326aab9222a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:09:20Z,use_quota=True,user_id='28efb816b29649c8a4d33ecb3beb8da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab70621e-256b-488d-9094-02a9359bbc7c),volume_type_id=ab70621e-256b-488d-9094-02a9359bbc7c)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Creating volume 043d5afb-9347-4e99-a44a-a5abff6b85ed {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:09:20 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:20 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed 1073741824 Sep 10 20:09:20 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:20 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:20 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:20 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941" returned: 0 in 1.092s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:20 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941 Sep 10 20:09:20 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:20 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.450s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:20 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 28 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed 1073741824" returned: 0 in 0.921s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:20 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.c00e07a6-db25-411b-b162-e7af6c099941" returned: 0 in 0.387s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-c00e07a6-db25-411b-b162-e7af6c099941" released by "_delete_snapshot" :: held 3.016s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" released by "delete_snapshot" :: held 3.054s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:21 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed Sep 10 20:09:21 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Created reservations ['4fd5869e-2668-4709-a210-a65307c9d669', '11a541a9-d486-4e01-9974-a054eed5ad55', '03b9d6d4-7c57-496e-ade3-274ab195229b', '253398ce-fca7-43ce-b06e-8da05fb2ad6f'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Delete snapshot completed successfully. Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fee40009-543e-43e4-b931-c28a7c9e3b2a tempest-SnapshotsActionsTest-975817987 None] Lock "cinder-c00e07a6-db25-411b-b162-e7af6c099941-delete_snapshot" released by "delete_snapshot" :: held 3.382s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:21 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed" returned: 0 in 0.592s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7866ee7-b65a-449c-a9dc-b8a35ad201b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-043d5afb-9347-4e99-a44a-a5abff6b85ed', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8358213-b110-4583-9a45-a4eccf85605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:21 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Volume volume-043d5afb-9347-4e99-a44a-a5abff6b85ed (043d5afb-9347-4e99-a44a-a5abff6b85ed): created successfully Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8358213-b110-4583-9a45-a4eccf85605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Flow 'volume_create_manager' (cdd63d1e-7497-44db-b10d-1731c182ba4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:09:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f3226605-b14e-4d0d-9fd0-5ef12c46fae1 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Created volume successfully. Sep 10 20:09:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "cinder-72465937-253a-4aa0-af99-cafce460a55d-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-72465937-253a-4aa0-af99-cafce460a55d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "cinder-quobyte-72465937-253a-4aa0-af99-cafce460a55d" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-quobyte-72465937-253a-4aa0-af99-cafce460a55d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Deleting offline snapshot 72465937-253a-4aa0-af99-cafce460a55d of volume 9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] snapshot_file for this snap is: volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6d4702-f099-4119-9fab-d2b1d634e9b2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:23 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:09:23 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ea91e81d-69fc-4ef2-a109-debb0f7e5470 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ea91e81d-69fc-4ef2-a109-debb0f7e5470 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ea91e81d-69fc-4ef2-a109-debb0f7e5470 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ea91e81d-69fc-4ef2-a109-debb0f7e5470 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ea91e81d-69fc-4ef2-a109-debb0f7e5470 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea91e81d-69fc-4ef2-a109-debb0f7e5470 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:23 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:23 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:23 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.547s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bdc0a70-2b85-4116-b898-aa83aab437e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec09c978-023a-4566-b575-552991ba3b5e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:23 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 Sep 10 20:09:23 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:23 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea91e81d-69fc-4ef2-a109-debb0f7e5470 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.265s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:23 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-ea91e81d-69fc-4ef2-a109-debb0f7e5470 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ea91e81d-69fc-4ef2-a109-debb0f7e5470 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Retype volume completed successfully. Sep 10 20:09:24 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7" returned: 0 in 0.413s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:24 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:09:24 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:24 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.316s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:24 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d Sep 10 20:09:24 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:24 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7.72465937-253a-4aa0-af99-cafce460a55d" returned: 0 in 0.261s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-quobyte-72465937-253a-4aa0-af99-cafce460a55d" released by "_delete_snapshot" :: held 1.672s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" released by "delete_snapshot" :: held 1.707s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Acquiring lock "cinder-043d5afb-9347-4e99-a44a-a5abff6b85ed-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "cinder-043d5afb-9347-4e99-a44a-a5abff6b85ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Acquiring lock "cinder-quobyte-043d5afb-9347-4e99-a44a-a5abff6b85ed" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Created reservations ['81a14f98-2d06-4e6a-86ae-e62f0b63be4f', '0712ce47-d5b8-4657-9f91-91c68387c7d4', '9845ff06-881c-4e5e-9a7c-127a9995695e', 'f0ed0eb7-bd07-45f5-9a9d-8345cf131819'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "cinder-quobyte-043d5afb-9347-4e99-a44a-a5abff6b85ed" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[141189a6-19d5-4109-b750-0012bfe04dd7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:24 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Delete snapshot completed successfully. Sep 10 20:09:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fe8c1be8-ed92-4b8e-805f-a510e25e3fcc tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-72465937-253a-4aa0-af99-cafce460a55d-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:24 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed Sep 10 20:09:24 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "cinder-9bdc0a70-2b85-4116-b898-aa83aab437e7-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-9bdc0a70-2b85-4116-b898-aa83aab437e7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9eadb6-3e48-4b7f-abf9-c10df9ceef81]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:25 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed" returned: 0 in 0.420s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:25 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed Sep 10 20:09:25 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:25 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 Sep 10 20:09:25 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:25 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-043d5afb-9347-4e99-a44a-a5abff6b85ed" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "cinder-quobyte-043d5afb-9347-4e99-a44a-a5abff6b85ed" released by "delete_volume" :: held 0.722s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:25 devstack cinder-volume[88137]: WARNING cinder.quota [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:09:25 devstack cinder-volume[88137]: WARNING cinder.quota [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Created reservations ['62792845-1039-421e-ab5d-65e73d91bf33', '737c9981-cc04-4c03-89dd-3dfff7625216', '2e5efd1b-f99f-4797-8130-ecc8d4cfae9c', 'a952fca9-528b-4fa6-ba39-db3dbc6b6f2c'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:25 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7" returned: 0 in 0.388s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:25 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7 Sep 10 20:09:25 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:25 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:25 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:25 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9bdc0a70-2b85-4116-b898-aa83aab437e7" returned: 0 in 0.269s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-quobyte-9bdc0a70-2b85-4116-b898-aa83aab437e7" released by "delete_volume" :: held 0.720s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Created reservations ['67feee3f-ff73-4725-858f-03d221e03798', 'bb4440da-9697-45b9-906e-c7b91a2b6b7c', '502b4b64-702b-4e38-9201-592b3ad1900e', '0dc2f702-53c3-4b3e-8768-416e8b4e4d51'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:25 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.302s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:25 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Deleted volume successfully. Sep 10 20:09:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55c364f3-9958-44a2-bef7-d1234691a117 tempest-VolumeRetypeWithoutMigrationTest-2030817175 None] Lock "cinder-043d5afb-9347-4e99-a44a-a5abff6b85ed-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:26 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:26 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:26 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.283s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:26 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:26 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Deleted volume successfully. Sep 10 20:09:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d54153d1-8d57-4e03-aab8-38a36c9d4622 tempest-SnapshotsActionsTest-2042901133 None] Lock "cinder-9bdc0a70-2b85-4116-b898-aa83aab437e7-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-4ea99709-65d0-447b-a70e-5f4b4a19cfda tempest-ServerActionsTestOtherA-528726344 None] Terminate volume connection completed successfully. Sep 10 20:09:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-4ea99709-65d0-447b-a70e-5f4b4a19cfda tempest-ServerActionsTestOtherA-528726344 None] Deleting attachment 01640cb4-110c-4ffb-afa6-bfaa151c3214. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:09:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "cinder-85a0658f-62b7-477e-8f78-1fb5a015ff71-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Lock "cinder-85a0658f-62b7-477e-8f78-1fb5a015ff71-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "cinder-quobyte-85a0658f-62b7-477e-8f78-1fb5a015ff71" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Lock "cinder-quobyte-85a0658f-62b7-477e-8f78-1fb5a015ff71" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8bd00a-afc4-4d27-a7ab-8409189cbe9f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:35 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 Sep 10 20:09:35 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:35 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71" returned: 0 in 0.548s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:35 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71 Sep 10 20:09:35 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:35 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-85a0658f-62b7-477e-8f78-1fb5a015ff71" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Lock "cinder-quobyte-85a0658f-62b7-477e-8f78-1fb5a015ff71" released by "delete_volume" :: held 0.919s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG cinder.quota [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Created reservations ['7b1a8e7a-db25-4166-bb1f-7050d4e31c10', 'b33ebcf4-f162-45f7-ad28-1e40a23fbfcb', 'dffd7e7f-b4d2-4eed-8fb5-38a6c71eb31b', '3750e4fa-322b-4ae6-818f-3b7831848a06'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:35 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:35 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:36 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.281s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:36 devstack cinder-volume[88137]: DEBUG cinder.manager [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Deleted volume successfully. Sep 10 20:09:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-3e3a50a6-8414-4f8a-99de-6f8b64763636 req-c518f93d-27d5-46a8-9cfc-80ae1b672bd2 tempest-ServerActionsTestOtherA-528726344 None] Lock "cinder-85a0658f-62b7-477e-8f78-1fb5a015ff71-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "cinder-37de651d-26ee-4d66-a410-02d4bfbc81de-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Lock "cinder-37de651d-26ee-4d66-a410-02d4bfbc81de-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "cinder-quobyte-37de651d-26ee-4d66-a410-02d4bfbc81de" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Lock "cinder-quobyte-37de651d-26ee-4d66-a410-02d4bfbc81de" acquired by "delete_volume" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[49774d75-cf72-4288-99e5-b589bfa1df9e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:36 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de Sep 10 20:09:36 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:37 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de" returned: 0 in 0.416s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:37 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de Sep 10 20:09:37 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:37 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-37de651d-26ee-4d66-a410-02d4bfbc81de" returned: 0 in 0.325s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Lock "cinder-quobyte-37de651d-26ee-4d66-a410-02d4bfbc81de" released by "delete_volume" :: held 0.810s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Created reservations ['a80bfe1a-a702-499c-b7ac-4291a1ce636a', '22b02269-7c8d-4f06-a8ab-8725b3f6a4d9', '2b47fa2d-490e-465a-bb1a-e7483ce12d8d', 'faba7db2-6729-4364-867b-c35f51b7a61d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:37 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:37 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:37 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.282s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Deleted volume successfully. Sep 10 20:09:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e4abbad8-5794-44d5-8232-70095335d7fe tempest-ServerActionsTestOtherA-528726344 None] Lock "cinder-37de651d-26ee-4d66-a410-02d4bfbc81de-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:47 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:INSERT=22,cinder:UPDATE=75,cinder:SELECT=79,cinder:DELETE=5 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:09:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Acquiring lock "cinder-fdd9cb32-336f-4c9f-866e-d37c6b5787d6-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "cinder-fdd9cb32-336f-4c9f-866e-d37c6b5787d6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Acquiring lock "cinder-quobyte-fdd9cb32-336f-4c9f-866e-d37c6b5787d6" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "cinder-quobyte-fdd9cb32-336f-4c9f-866e-d37c6b5787d6" acquired by "delete_volume" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:48 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b4d274-1c06-41a9-b155-cfa0910b2b3d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:49 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 Sep 10 20:09:49 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:49 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6" returned: 0 in 0.480s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:49 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6 Sep 10 20:09:49 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:49 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fdd9cb32-336f-4c9f-866e-d37c6b5787d6" returned: 0 in 0.284s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "cinder-quobyte-fdd9cb32-336f-4c9f-866e-d37c6b5787d6" released by "delete_volume" :: held 0.841s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Created reservations ['3add3691-6aea-4c52-86b5-bfda3589e273', '6e04d6de-29f3-4ec7-8e9d-8469cb4fe0e2', '986e8524-a4b5-48dd-974a-b0d86422f1cf', 'c7b3b585-69ac-439d-bb42-ec66f42c3ef4'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:49 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:49 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:50 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.305s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:50 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:50 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Deleted volume successfully. Sep 10 20:09:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d2f2cc2c-6ff3-4a16-84a0-d26fcb9c19a2 tempest-AttachVolumeShelveTestJSON-4752798 None] Lock "cinder-fdd9cb32-336f-4c9f-866e-d37c6b5787d6-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Flow 'volume_create_manager' (2a168b85-8ddb-49a5-a1bc-0198a5b134d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc4f1c6-4a17-4cdf-931d-0bbb6eb91b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc4f1c6-4a17-4cdf-931d-0bbb6eb91b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1259309523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ad09a2-868b-4796-9672-4b5f21c8a8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4efdc8a7774616a54692de5d5d93aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:09:54Z,use_quota=True,user_id='a15ad90fa8f4487b81547895ef7edc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee49b26-71cb-45c7-8ecc-9d77854fa143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee49b26-71cb-45c7-8ecc-9d77854fa143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db57805-ccfa-4f68-9d79-69f421ae3365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db57805-ccfa-4f68-9d79-69f421ae3365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38ad09a2-868b-4796-9672-4b5f21c8a8b8', 'volume_name': 'volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8140a12a-765e-44f2-9737-e2db73cb1b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8140a12a-765e-44f2-9737-e2db73cb1b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ae1ed3-e1b4-4ef5-9fdb-a742812b34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:53 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Volume 38ad09a2-868b-4796-9672-4b5f21c8a8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8', 'volume_size': 1} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1259309523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ad09a2-868b-4796-9672-4b5f21c8a8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a4efdc8a7774616a54692de5d5d93aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:09:54Z,use_quota=True,user_id='a15ad90fa8f4487b81547895ef7edc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Creating volume 38ad09a2-868b-4796-9672-4b5f21c8a8b8 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:09:53 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:09:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:53 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 1073741824 Sep 10 20:09:53 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:54 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 1073741824" returned: 0 in 0.516s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:54 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 Sep 10 20:09:54 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Flow 'volume_create_manager' (af381418-7658-4e0a-a867-1598c608c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09007799-b9f1-46d3-a4c2-cdc7dc25ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:54 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8" returned: 0 in 0.504s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09007799-b9f1-46d3-a4c2-cdc7dc25ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-206797455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cd7875-471f-4385-b9a1-a0ed60636432,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdd97a262cc445179692ee2610331d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:09:55Z,use_quota=True,user_id='dda04e55a57f4d678023d45fc6f59b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc6817d-0b37-4595-850c-d335d19361cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc6817d-0b37-4595-850c-d335d19361cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ceca19-f074-4e8a-8d74-4e59ed3c7145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ceca19-f074-4e8a-8d74-4e59ed3c7145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8cd7875-471f-4385-b9a1-a0ed60636432', 'volume_name': 'volume-a8cd7875-471f-4385-b9a1-a0ed60636432', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e41dd93-3832-4fa4-a572-a6110cab1165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e41dd93-3832-4fa4-a572-a6110cab1165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97e4e01-0378-4152-8193-2588198721c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:54 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Volume a8cd7875-471f-4385-b9a1-a0ed60636432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8cd7875-471f-4385-b9a1-a0ed60636432', 'volume_size': 1} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-206797455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cd7875-471f-4385-b9a1-a0ed60636432,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdd97a262cc445179692ee2610331d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:09:55Z,use_quota=True,user_id='dda04e55a57f4d678023d45fc6f59b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Creating volume a8cd7875-471f-4385-b9a1-a0ed60636432 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:09:54 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:54 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432 1073741824 Sep 10 20:09:54 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ae1ed3-e1b4-4ef5-9fdb-a742812b34f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1573bce1-db31-419a-9a9b-e953be68d819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:54 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Volume volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 (38ad09a2-868b-4796-9672-4b5f21c8a8b8): created successfully Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1573bce1-db31-419a-9a9b-e953be68d819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Flow 'volume_create_manager' (2a168b85-8ddb-49a5-a1bc-0198a5b134d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:09:54 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c009eb51-e925-4886-9997-22658a5c7072 tempest-VolumesMetadataTest-360490485 None] Created volume successfully. Sep 10 20:09:55 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432 1073741824" returned: 0 in 0.486s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:55 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432 Sep 10 20:09:55 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:55 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432" returned: 0 in 0.307s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:09:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97e4e01-0378-4152-8193-2588198721c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8cd7875-471f-4385-b9a1-a0ed60636432', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d63f56-53fb-4095-92b0-894001779f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:09:55 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Volume volume-a8cd7875-471f-4385-b9a1-a0ed60636432 (a8cd7875-471f-4385-b9a1-a0ed60636432): created successfully Sep 10 20:09:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d63f56-53fb-4095-92b0-894001779f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:09:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Flow 'volume_create_manager' (af381418-7658-4e0a-a867-1598c608c55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:09:55 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-c68462d8-3e58-44f2-a5d7-b36c167c7760 req-eeb58c16-5383-42e5-829b-81fe88f87319 tempest-VolumesGetTestJSON-1961884587 None] Created volume successfully. Sep 10 20:09:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Acquiring lock "cinder-a8cd7875-471f-4385-b9a1-a0ed60636432-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Lock "cinder-a8cd7875-471f-4385-b9a1-a0ed60636432-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Acquiring lock "cinder-quobyte-a8cd7875-471f-4385-b9a1-a0ed60636432" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Lock "cinder-quobyte-a8cd7875-471f-4385-b9a1-a0ed60636432" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:56 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73674e1-3c0a-4fd8-aae3-2bfb72ddc5d3]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:56 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432 Sep 10 20:09:56 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Acquiring lock "cinder-38ad09a2-868b-4796-9672-4b5f21c8a8b8-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Lock "cinder-38ad09a2-868b-4796-9672-4b5f21c8a8b8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Acquiring lock "cinder-quobyte-38ad09a2-868b-4796-9672-4b5f21c8a8b8" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Lock "cinder-quobyte-38ad09a2-868b-4796-9672-4b5f21c8a8b8" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a56289-b2e8-4f9f-a18b-55c449409616]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:57 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 Sep 10 20:09:57 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:57 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432" returned: 0 in 0.598s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:57 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432 Sep 10 20:09:57 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:57 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8" returned: 0 in 0.432s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:57 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a8cd7875-471f-4385-b9a1-a0ed60636432" returned: 0 in 0.302s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:57 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8 Sep 10 20:09:57 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Lock "cinder-quobyte-a8cd7875-471f-4385-b9a1-a0ed60636432" released by "delete_volume" :: held 0.966s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.quota [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Created reservations ['2529f117-2ad8-420f-a2d8-9b514e425540', 'b8cdc125-240e-4bff-bc6d-e558918a21b7', 'f5b9fb3a-646e-4b1b-82c7-2f61b6b16af7', '01b0f90a-88bc-4675-8397-b3a9d8540c0a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:57 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:57 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:57 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-38ad09a2-868b-4796-9672-4b5f21c8a8b8" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Lock "cinder-quobyte-38ad09a2-868b-4796-9672-4b5f21c8a8b8" released by "delete_volume" :: held 0.786s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:57 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Created reservations ['a683c4ef-aea1-4030-a5db-3164e87dd6ac', 'fd4dd96f-93ee-4f39-aaeb-530332fefb87', '7867f65d-978a-4b4f-9fb1-d0a9585cee7a', 'f16b142f-d34b-4ec0-af3e-20156fbc7ab3'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:09:58 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:09:58 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:09:58 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.297s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG cinder.manager [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Deleted volume successfully. Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-178c1daa-f452-4ad9-9c3f-2f43cfe02de3 req-9abcf85a-8c3c-41bd-a479-cb6888c91c30 tempest-VolumesGetTestJSON-1961884587 None] Lock "cinder-a8cd7875-471f-4385-b9a1-a0ed60636432-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:09:58 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.284s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:09:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Deleted volume successfully. Sep 10 20:09:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b2fcbe6e-a2ab-453e-b02c-0994fce83f54 tempest-VolumesMetadataTest-360490485 None] Lock "cinder-38ad09a2-868b-4796-9672-4b5f21c8a8b8-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a3dceb3-967d-435c-a18a-7feca12efb80 tempest-BackendsCapabilitiesAdminTestsJSON-861611473 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1409454345703, 'free_capacity_gb': 1773.1409454345703, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88137) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 20:10:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-98ab3b73-0b92-4f2b-8525-9b63441769f5 tempest-BackendsCapabilitiesAdminTestsJSON-861611473 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1409454345703, 'free_capacity_gb': 1773.1409454345703, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88137) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Flow 'volume_create_manager' (ea52f4d5-2c8c-4134-9061-e7e957e6eeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f62f32a-1b8f-42ed-a0bc-e9201e2ec922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f62f32a-1b8f-42ed-a0bc-e9201e2ec922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1343293725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579f1078-5ef2-4688-be7c-b399e1865458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d09c48c75fb45f699c1b20bea6767f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:07Z,use_quota=True,user_id='4ee4f02ecbc94c6db073f3f6cf09e18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c91196-9600-4554-b787-ea1af3ca141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c91196-9600-4554-b787-ea1af3ca141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84a737d-4b36-411d-ab53-b5008b02019f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84a737d-4b36-411d-ab53-b5008b02019f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579f1078-5ef2-4688-be7c-b399e1865458', 'volume_name': 'volume-579f1078-5ef2-4688-be7c-b399e1865458', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15a55ac-05f2-4dd8-ae33-3d40d900bb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15a55ac-05f2-4dd8-ae33-3d40d900bb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1041972e-f8e8-4f71-adc5-b1f3326420db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:07 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Volume 579f1078-5ef2-4688-be7c-b399e1865458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579f1078-5ef2-4688-be7c-b399e1865458', 'volume_size': 1} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1343293725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579f1078-5ef2-4688-be7c-b399e1865458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d09c48c75fb45f699c1b20bea6767f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:07Z,use_quota=True,user_id='4ee4f02ecbc94c6db073f3f6cf09e18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Creating volume 579f1078-5ef2-4688-be7c-b399e1865458 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:07 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:07 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458 1073741824 Sep 10 20:10:07 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:08 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458 1073741824" returned: 0 in 0.551s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:08 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458 Sep 10 20:10:08 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:08 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458" returned: 0 in 0.365s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1041972e-f8e8-4f71-adc5-b1f3326420db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579f1078-5ef2-4688-be7c-b399e1865458', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5af2a4e-3814-4d95-aa2b-c361c001f907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:08 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Volume volume-579f1078-5ef2-4688-be7c-b399e1865458 (579f1078-5ef2-4688-be7c-b399e1865458): created successfully Sep 10 20:10:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5af2a4e-3814-4d95-aa2b-c361c001f907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Flow 'volume_create_manager' (ea52f4d5-2c8c-4134-9061-e7e957e6eeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:08 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1915c4e4-f3ef-4093-af4e-252c3a26a024 tempest-VolumesTransfersTest-1991624457 None] Created volume successfully. Sep 10 20:10:11 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-247b072f-a57d-4561-afad-579375bf6aeb tempest-VolumesTransfersTest-1699036866 None] Transfer volume completed successfully. Sep 10 20:10:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Acquiring lock "cinder-579f1078-5ef2-4688-be7c-b399e1865458-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Lock "cinder-579f1078-5ef2-4688-be7c-b399e1865458-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Acquiring lock "cinder-quobyte-579f1078-5ef2-4688-be7c-b399e1865458" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Lock "cinder-quobyte-579f1078-5ef2-4688-be7c-b399e1865458" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:12 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab11f46d-8273-45ee-a879-6621a7ec2ddc]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:12 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458 Sep 10 20:10:12 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:12 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458" returned: 0 in 0.621s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:12 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458 Sep 10 20:10:12 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:13 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-579f1078-5ef2-4688-be7c-b399e1865458" returned: 0 in 0.302s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Lock "cinder-quobyte-579f1078-5ef2-4688-be7c-b399e1865458" released by "delete_volume" :: held 0.989s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Created reservations ['5b869c2a-01b1-49a6-8b37-8ff9b67af233', '5b7213b7-5e33-4aa8-9f58-ba3fb3ce8333', '2317803b-d914-4bb5-9fb8-b0f40e0ad83c', 'e12cc9e7-6b8b-491f-bc2a-4c9ed484b4c0'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:13 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:13 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:13 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.285s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:13 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Deleted volume successfully. Sep 10 20:10:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-89c5f234-22a9-44f0-81f2-74137fa64a5d tempest-VolumesTransfersTest-1866339871 None] Lock "cinder-579f1078-5ef2-4688-be7c-b399e1865458-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Flow 'volume_create_manager' (b681fa7a-3882-4016-9a60-c9df15b3e594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8f4787-2881-40f8-9d24-41bfae108bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8f4787-2881-40f8-9d24-41bfae108bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-98914541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56136925-686b-4fad-8a4e-c73fab0b1b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c55dfe70564375be089c777f2dd0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:14Z,use_quota=True,user_id='1bf3e8600eb745acb3c3073bd0f70cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d564e40-74dd-448d-8bb0-e2183540f9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d564e40-74dd-448d-8bb0-e2183540f9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96137a5-2395-485e-996d-ab3e2af460ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96137a5-2395-485e-996d-ab3e2af460ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56136925-686b-4fad-8a4e-c73fab0b1b07', 'volume_name': 'volume-56136925-686b-4fad-8a4e-c73fab0b1b07', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc0e8b2-6700-4477-86c1-07a91a96d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc0e8b2-6700-4477-86c1-07a91a96d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e317e40f-9dde-46c0-ab51-916fa235a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:14 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Volume 56136925-686b-4fad-8a4e-c73fab0b1b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56136925-686b-4fad-8a4e-c73fab0b1b07', 'volume_size': 1} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-98914541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56136925-686b-4fad-8a4e-c73fab0b1b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c55dfe70564375be089c777f2dd0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:14Z,use_quota=True,user_id='1bf3e8600eb745acb3c3073bd0f70cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Creating volume 56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:14 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:14 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 1073741824 Sep 10 20:10:14 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Flow 'volume_create_manager' (418e27e3-58b1-4151-913f-a96bbb41d454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38e8bf1-f4ef-4124-baee-23771a83c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38e8bf1-f4ef-4124-baee-23771a83c11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1260438869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfab4696-e5e4-443a-b60d-9f69e74dde77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d09c48c75fb45f699c1b20bea6767f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:15Z,use_quota=True,user_id='4ee4f02ecbc94c6db073f3f6cf09e18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba422ab6-2d69-48a3-8538-6978f1eb5f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba422ab6-2d69-48a3-8538-6978f1eb5f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b228bcf-4013-4aaf-81ec-11939313c062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b228bcf-4013-4aaf-81ec-11939313c062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfab4696-e5e4-443a-b60d-9f69e74dde77', 'volume_name': 'volume-bfab4696-e5e4-443a-b60d-9f69e74dde77', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd42bd9-0cdf-4565-8851-ffaf83954383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd42bd9-0cdf-4565-8851-ffaf83954383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14aa9bd0-c195-4b16-99a2-3b0a9c864ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:15 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Volume bfab4696-e5e4-443a-b60d-9f69e74dde77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfab4696-e5e4-443a-b60d-9f69e74dde77', 'volume_size': 1} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:15 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 1073741824" returned: 0 in 0.686s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:15 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 Sep 10 20:10:15 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:15 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07" returned: 0 in 0.374s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1260438869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfab4696-e5e4-443a-b60d-9f69e74dde77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d09c48c75fb45f699c1b20bea6767f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:15Z,use_quota=True,user_id='4ee4f02ecbc94c6db073f3f6cf09e18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Creating volume bfab4696-e5e4-443a-b60d-9f69e74dde77 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:15 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:15 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 1073741824 Sep 10 20:10:15 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e317e40f-9dde-46c0-ab51-916fa235a43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56136925-686b-4fad-8a4e-c73fab0b1b07', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab08f4a-adf4-4759-b825-59e3a163a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:15 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Volume volume-56136925-686b-4fad-8a4e-c73fab0b1b07 (56136925-686b-4fad-8a4e-c73fab0b1b07): created successfully Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab08f4a-adf4-4759-b825-59e3a163a04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Flow 'volume_create_manager' (b681fa7a-3882-4016-9a60-c9df15b3e594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:15 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f0ccd309-4689-43fd-beff-0b8f3198c554 tempest-VolumesDeleteCascade-2011900565 None] Created volume successfully. Sep 10 20:10:16 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fb18004b-d234-4056-86fb-61170e3375bf tempest-GroupsTest-1076866471 None] Group tempest-Group1-1148205157: creating Sep 10 20:10:16 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fb18004b-d234-4056-86fb-61170e3375bf tempest-GroupsTest-1076866471 None] Group tempest-Group1-1148205157: created successfully Sep 10 20:10:16 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fb18004b-d234-4056-86fb-61170e3375bf tempest-GroupsTest-1076866471 None] Create group completed successfully. Sep 10 20:10:16 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 1073741824" returned: 0 in 0.571s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:16 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 Sep 10 20:10:16 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:16 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77" returned: 0 in 0.277s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14aa9bd0-c195-4b16-99a2-3b0a9c864ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfab4696-e5e4-443a-b60d-9f69e74dde77', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fa4583-eda5-4261-8f23-5c776d0e7ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:16 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Volume volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 (bfab4696-e5e4-443a-b60d-9f69e74dde77): created successfully Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fa4583-eda5-4261-8f23-5c776d0e7ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Flow 'volume_create_manager' (418e27e3-58b1-4151-913f-a96bbb41d454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:16 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e8cdacda-1fc5-482f-8fcd-e268521baa40 tempest-VolumesTransfersTest-1991624457 None] Created volume successfully. Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Creating offline snapshot 749279ce-95f7-485e-88d2-98d2ad2e7617 of volume 56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a25718b-3790-478b-893e-3d02002f2176]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:16 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 Sep 10 20:10:16 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:17 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07" returned: 0 in 0.515s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3d3f54ae-4a42-464c-bb69-3d955d426d50 tempest-GroupsTest-1076866471 None] Group tempest-Group2-1653921747: creating Sep 10 20:10:17 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 1G Sep 10 20:10:17 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3d3f54ae-4a42-464c-bb69-3d955d426d50 tempest-GroupsTest-1076866471 None] Group tempest-Group2-1653921747: created successfully Sep 10 20:10:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3d3f54ae-4a42-464c-bb69-3d955d426d50 tempest-GroupsTest-1076866471 None] Create group completed successfully. Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Acquiring lock "cinder-bfab4696-e5e4-443a-b60d-9f69e74dde77-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Lock "cinder-bfab4696-e5e4-443a-b60d-9f69e74dde77-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Acquiring lock "cinder-quobyte-bfab4696-e5e4-443a-b60d-9f69e74dde77" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Lock "cinder-quobyte-bfab4696-e5e4-443a-b60d-9f69e74dde77" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7283262-d20c-444c-9409-d9ce3cbd8e36]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:17 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 1G" returned: 0 in 0.548s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56136925-686b-4fad-8a4e-c73fab0b1b07 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:17 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 Sep 10 20:10:17 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:17 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56136925-686b-4fad-8a4e-c73fab0b1b07 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 Sep 10 20:10:17 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:18 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77" returned: 0 in 0.584s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:18 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56136925-686b-4fad-8a4e-c73fab0b1b07 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617" returned: 0 in 0.489s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:18 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 is being set with open permissions: ugo+rw Sep 10 20:10:18 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77 Sep 10 20:10:18 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:18 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 Sep 10 20:10:18 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:18 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617" returned: 0 in 0.364s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:18 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bfab4696-e5e4-443a-b60d-9f69e74dde77" returned: 0 in 0.528s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Lock "cinder-quobyte-bfab4696-e5e4-443a-b60d-9f69e74dde77" released by "delete_volume" :: held 1.179s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:18 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.info Sep 10 20:10:18 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:18 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Created reservations ['8080addd-4e8d-422d-b8fe-6a3c27313b4d', 'd741891d-58c1-4a87-b5d2-d11d4905e6b8', '103d3f00-1ba5-4dfa-9a8a-13dbcc926a65', 'd618d9d0-bc2e-45ff-ae99-b7db92d2018a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:19 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:19 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:19 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.info" returned: 0 in 0.393s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:19 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.info is being set with open permissions: ugo+rw Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:19 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.info Sep 10 20:10:19 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Flow 'volume_create_manager' (a6a8675c-0bfb-4a74-a2ea-1e177a625782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8f392c-a1b1-4b3a-9a78-4e7731d9b9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:19 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.356s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Deleted volume successfully. Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8f392c-a1b1-4b3a-9a78-4e7731d9b9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1746160060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b269c51c-e9ea-4c26-9e9f-c01af7adb854,host='devstack@QuobyteHD#QuobyteHD',id=0b990499-dd20-4c78-8f04-ef83c137eb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8f917cc21b459a9ca6b62d3e16ee44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:19Z,use_quota=True,user_id='956dcee81e4048e98f3b54f9c902771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d6a331f-5ba9-4592-9b53-2c05dfd7f41b),volume_type_id=5d6a331f-5ba9-4592-9b53-2c05dfd7f41b)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483f3d5e-7bab-41e8-b932-a6179e396281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483f3d5e-7bab-41e8-b932-a6179e396281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08215ae9-d983-4960-9215-6689c48042be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08215ae9-d983-4960-9215-6689c48042be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b990499-dd20-4c78-8f04-ef83c137eb43', 'volume_name': 'volume-0b990499-dd20-4c78-8f04-ef83c137eb43', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e36f0f-f34c-45d3-bb06-cc1fb0967028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e36f0f-f34c-45d3-bb06-cc1fb0967028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c56578-2033-44fe-8eed-ab824df3e66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Volume 0b990499-dd20-4c78-8f04-ef83c137eb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b990499-dd20-4c78-8f04-ef83c137eb43', 'volume_size': 1} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de2184fd-983f-4a40-bfb0-5a88ee90fcac tempest-VolumesTransfersTest-1866339871 None] Lock "cinder-bfab4696-e5e4-443a-b60d-9f69e74dde77-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:19 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.info" returned: 0 in 0.341s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.796s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b269c51c-e9ea-4c26-9e9f-c01af7adb854,created_at=2026-09-10T18:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1746160060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b269c51c-e9ea-4c26-9e9f-c01af7adb854,host='devstack@QuobyteHD#QuobyteHD',id=0b990499-dd20-4c78-8f04-ef83c137eb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8f917cc21b459a9ca6b62d3e16ee44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:19Z,use_quota=True,user_id='956dcee81e4048e98f3b54f9c902771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d6a331f-5ba9-4592-9b53-2c05dfd7f41b),volume_type_id=5d6a331f-5ba9-4592-9b53-2c05dfd7f41b)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Creating volume 0b990499-dd20-4c78-8f04-ef83c137eb43 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:19 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:19 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43 1073741824 Sep 10 20:10:19 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-db8f077a-5cea-4d87-827c-9b07a97f8e95 tempest-VolumesDeleteCascade-2011900565 None] Create snapshot completed successfully Sep 10 20:10:20 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43 1073741824" returned: 0 in 0.550s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=87,cinder:UPDATE=119,cinder:INSERT=26,cinder:DELETE=6 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:20 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43 Sep 10 20:10:20 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:20 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:20 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:20 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.351s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c56578-2033-44fe-8eed-ab824df3e66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b990499-dd20-4c78-8f04-ef83c137eb43', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c4c4d1-df68-4889-ad62-50cc96edfabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Creating offline snapshot fcac9d75-0a20-4d55-989e-82619d17c281 of volume 56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:10:20 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Volume volume-0b990499-dd20-4c78-8f04-ef83c137eb43 (0b990499-dd20-4c78-8f04-ef83c137eb43): created successfully Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c4c4d1-df68-4889-ad62-50cc96edfabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Flow 'volume_create_manager' (a6a8675c-0bfb-4a74-a2ea-1e177a625782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7552f-450b-40dc-ab0d-24b9f9c2c8cc]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:20 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a4b4acbc-7953-4d88-a882-7cb34cb050d1 tempest-GroupsTest-1076866471 None] Created volume successfully. Sep 10 20:10:20 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.379s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 28 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:10:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:10:20 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 Sep 10 20:10:20 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617" returned: 0 in 0.521s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56136925-686b-4fad-8a4e-c73fab0b1b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:10:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:21 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:21 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 1G Sep 10 20:10:21 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:22 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 1G" returned: 0 in 1.075s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:22 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 Sep 10 20:10:22 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:22 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281" returned: 0 in 0.480s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:22 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 is being set with open permissions: ugo+rw Sep 10 20:10:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:22 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 Sep 10 20:10:22 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:23 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281" returned: 0 in 0.407s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-7cd1085f-2fc2-401e-8c50-28f51975031d tempest-VolumesDeleteCascade-2011900565 None] Create snapshot completed successfully Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Acquiring lock "cinder-quobyte-0b990499-dd20-4c78-8f04-ef83c137eb43" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Lock "cinder-quobyte-0b990499-dd20-4c78-8f04-ef83c137eb43" acquired by "delete_volume" :: waited 0.060s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6a1eb5-859f-4c09-a5e8-3a4ff1b8be22]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-56136925-686b-4fad-8a4e-c73fab0b1b07-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:23 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43 Sep 10 20:10:23 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-56136925-686b-4fad-8a4e-c73fab0b1b07-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Performing cascade delete. {{(pid=88137) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-749279ce-95f7-485e-88d2-98d2ad2e7617-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-749279ce-95f7-485e-88d2-98d2ad2e7617-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-56136925-686b-4fad-8a4e-c73fab0b1b07" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-56136925-686b-4fad-8a4e-c73fab0b1b07" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-749279ce-95f7-485e-88d2-98d2ad2e7617" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-749279ce-95f7-485e-88d2-98d2ad2e7617" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Deleting offline snapshot 749279ce-95f7-485e-88d2-98d2ad2e7617 of volume 56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] snapshot_file for this snap is: volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e1785-abbe-4c1f-942a-71c445a10712]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:24 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43" returned: 0 in 0.598s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:24 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 Sep 10 20:10:24 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:24 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43 Sep 10 20:10:24 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:24 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617" returned: 0 in 0.594s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56136925-686b-4fad-8a4e-c73fab0b1b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[72057945-879b-41c2-acf0-231fabf18f58]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:24 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b990499-dd20-4c78-8f04-ef83c137eb43" returned: 0 in 0.475s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Lock "cinder-quobyte-0b990499-dd20-4c78-8f04-ef83c137eb43" released by "delete_volume" :: held 1.156s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Created reservations ['acb1da98-a0e1-4636-a777-2fa01f32dddf'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:24 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 Sep 10 20:10:24 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:24 devstack cinder-volume[88137]: WARNING cinder.quota [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1312584334 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1312584334, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:10:24 devstack cinder-volume[88137]: WARNING cinder.quota [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1312584334 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1312584334, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:10:24 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Created reservations ['6c64a436-14fe-4ca7-b01d-2eae309663b1', '7633474e-5d46-4e7e-8793-a2ee427e6d26', 'b7d4f82a-abc1-4dcc-9bef-c40cc5e9f367', 'b50a0803-2bc3-4164-93e6-01d67f94249b'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:25 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:25 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:25 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07" returned: 0 in 0.841s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d39b2e7-4238-4dd5-945b-7d61a8e9693c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:25 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 Sep 10 20:10:25 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:25 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.549s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:25 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:25 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2cbb2cf8-a299-4953-b208-cf6889227bf2 tempest-GroupsTest-1076866471 None] Delete group completed successfully. Sep 10 20:10:26 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281" returned: 0 in 0.831s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56136925-686b-4fad-8a4e-c73fab0b1b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d43548-2f09-47d7-94fb-cc6802965cb6]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] Created reservations ['8ac79058-332c-4b64-932b-0a414657406d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:26 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 Sep 10 20:10:26 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:26 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:26 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:26 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617" returned: 0 in 0.621s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56136925-686b-4fad-8a4e-c73fab0b1b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:10:27 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fc0d8d-9275-4878-9118-275d7824f28d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:27 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.422s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:27 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-7f47d690-4046-452f-88f3-efa3c03e6b8e tempest-GroupsTest-1076866471 None] Delete group completed successfully. Sep 10 20:10:27 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 Sep 10 20:10:27 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:27 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07" returned: 0 in 0.512s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:27 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 Sep 10 20:10:27 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:28 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617" returned: 0 in 0.653s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:28 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617 Sep 10 20:10:28 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ef060a15-7269-46b3-805e-f5c44cb559b5 tempest-GroupsTest-1076866471 None] Group tempest-GroupsTest-Group-789335732: creating Sep 10 20:10:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ef060a15-7269-46b3-805e-f5c44cb559b5 tempest-GroupsTest-1076866471 None] Group tempest-GroupsTest-Group-789335732: created successfully Sep 10 20:10:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ef060a15-7269-46b3-805e-f5c44cb559b5 tempest-GroupsTest-1076866471 None] Create group completed successfully. Sep 10 20:10:28 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.749279ce-95f7-485e-88d2-98d2ad2e7617" returned: 0 in 0.365s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56136925-686b-4fad-8a4e-c73fab0b1b07 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 -F qcow2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:28 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56136925-686b-4fad-8a4e-c73fab0b1b07 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 -F qcow2 Sep 10 20:10:28 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:28 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56136925-686b-4fad-8a4e-c73fab0b1b07 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 -F qcow2" returned: 0 in 0.340s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-749279ce-95f7-485e-88d2-98d2ad2e7617" released by "_delete_snapshot" :: held 5.058s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-56136925-686b-4fad-8a4e-c73fab0b1b07" released by "delete_snapshot" :: held 5.092s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Created reservations ['46e1dd6c-c3f0-41cf-ada6-cde25bf56ed8', '1c171ef2-aa3b-4377-88d8-f790f11020dc', 'c9d4cdff-5dfb-4131-b851-b78428266523', '66e8e7ff-b345-4810-9259-e6bdb650308a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:29 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Delete snapshot completed successfully. Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-749279ce-95f7-485e-88d2-98d2ad2e7617-delete_snapshot" released by "delete_snapshot" :: held 5.293s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-fcac9d75-0a20-4d55-989e-82619d17c281-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-fcac9d75-0a20-4d55-989e-82619d17c281-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-56136925-686b-4fad-8a4e-c73fab0b1b07" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-56136925-686b-4fad-8a4e-c73fab0b1b07" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-fcac9d75-0a20-4d55-989e-82619d17c281" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-fcac9d75-0a20-4d55-989e-82619d17c281" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Deleting offline snapshot fcac9d75-0a20-4d55-989e-82619d17c281 of volume 56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] snapshot_file for this snap is: volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1045cd29-2be7-4c4f-9123-ee38966ddbf4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:29 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 Sep 10 20:10:29 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:29 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281" returned: 0 in 0.427s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56136925-686b-4fad-8a4e-c73fab0b1b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4986053b-8087-4c14-b242-34467d8e3f2b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:29 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 Sep 10 20:10:29 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:30 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07" returned: 0 in 0.510s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:30 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 Sep 10 20:10:30 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Flow 'volume_create_manager' (571134a9-c03e-4ecc-a121-17e1fe4b126b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7099a57-5bc2-4537-94aa-780129a202e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7099a57-5bc2-4537-94aa-780129a202e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067751015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4906537-06f4-4bf1-9dd4-6759355b5bc7,host='devstack@QuobyteHD#QuobyteHD',id=e599f2e2-e842-498a-9b13-f5ce0ad90ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8f917cc21b459a9ca6b62d3e16ee44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:30Z,use_quota=True,user_id='956dcee81e4048e98f3b54f9c902771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8fb2459-fdbc-4f42-b1d2-7216307fb77b),volume_type_id=f8fb2459-fdbc-4f42-b1d2-7216307fb77b)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfc0f0d-f322-402b-ae56-268705eea1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfc0f0d-f322-402b-ae56-268705eea1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d355aece-b182-4fc3-be11-a911fbf926c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d355aece-b182-4fc3-be11-a911fbf926c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e599f2e2-e842-498a-9b13-f5ce0ad90ce0', 'volume_name': 'volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e359ae-633a-417c-88a2-cf59797f715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e359ae-633a-417c-88a2-cf59797f715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e90c5f-7b60-4bd7-acd3-bf0a6b22d275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Volume e599f2e2-e842-498a-9b13-f5ce0ad90ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0', 'volume_size': 1} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4906537-06f4-4bf1-9dd4-6759355b5bc7,created_at=2026-09-10T18:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067751015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4906537-06f4-4bf1-9dd4-6759355b5bc7,host='devstack@QuobyteHD#QuobyteHD',id=e599f2e2-e842-498a-9b13-f5ce0ad90ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8f917cc21b459a9ca6b62d3e16ee44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:30Z,use_quota=True,user_id='956dcee81e4048e98f3b54f9c902771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8fb2459-fdbc-4f42-b1d2-7216307fb77b),volume_type_id=f8fb2459-fdbc-4f42-b1d2-7216307fb77b)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Creating volume e599f2e2-e842-498a-9b13-f5ce0ad90ce0 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:30 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:30 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 1073741824 Sep 10 20:10:30 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:30 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281" returned: 0 in 0.515s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:30 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281 Sep 10 20:10:30 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:31 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07.fcac9d75-0a20-4d55-989e-82619d17c281" returned: 0 in 0.330s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-fcac9d75-0a20-4d55-989e-82619d17c281" released by "_delete_snapshot" :: held 1.903s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-56136925-686b-4fad-8a4e-c73fab0b1b07" released by "delete_snapshot" :: held 1.931s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Created reservations ['b4d956cc-63ba-4d2e-a3a2-32cbeab49622', '3d347209-05c1-46ff-94bc-de2ed4a944af', 'f683fdbd-b3bf-4e0e-9c85-35fb68bdad32', '66bcd73f-3e16-433c-9f2e-a9f17e8df619'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:31 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 1073741824" returned: 0 in 0.580s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Delete snapshot completed successfully. Sep 10 20:10:31 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 Sep 10 20:10:31 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-fcac9d75-0a20-4d55-989e-82619d17c281-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Snapshots deleted, issuing volume delete {{(pid=88137) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-56136925-686b-4fad-8a4e-c73fab0b1b07" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-56136925-686b-4fad-8a4e-c73fab0b1b07" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab119fa-fad6-4aae-b1cc-93a5142c3bca]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Flow 'volume_create_manager' (1d00305b-545b-4bbf-ac3f-a765e8540c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b13308-6f83-4e07-baf4-d9d7968835cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b13308-6f83-4e07-baf4-d9d7968835cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-69817284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95709be9-04c0-447a-b40a-249cb6010b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4708f44ada9841f2918511c97cbcec35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:31Z,use_quota=True,user_id='1312dce52d564dbcb4cd0bf6fa7154f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae07d494-c1bc-466a-b7f6-7a40438a55e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae07d494-c1bc-466a-b7f6-7a40438a55e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2a99a3-40b1-4e4d-8c12-1c16cdf807ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:10:31 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 Sep 10 20:10:31 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:31 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0" returned: 0 in 0.434s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e90c5f-7b60-4bd7-acd3-bf0a6b22d275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058997c9-fbd6-4f25-ae14-7eb541389a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Volume volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 (e599f2e2-e842-498a-9b13-f5ce0ad90ce0): created successfully Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058997c9-fbd6-4f25-ae14-7eb541389a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Flow 'volume_create_manager' (571134a9-c03e-4ecc-a121-17e1fe4b126b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-246526b8-c0e3-44b1-ac3c-10e8820c9396 tempest-GroupsTest-1076866471 None] Created volume successfully. Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2a99a3-40b1-4e4d-8c12-1c16cdf807ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95709be9-04c0-447a-b40a-249cb6010b3c', 'volume_name': 'volume-95709be9-04c0-447a-b40a-249cb6010b3c', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49265a1a-3965-4ff4-bfb2-fe92331f247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49265a1a-3965-4ff4-bfb2-fe92331f247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f24a8cf-9b7a-4faa-b1a9-67347d4d591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Volume 95709be9-04c0-447a-b40a-249cb6010b3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95709be9-04c0-447a-b40a-249cb6010b3c', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Trying to clone 95709be9-04c0-447a-b40a-249cb6010b3c from image c78ee229-c276-4323-b914-d91a23a49bd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:10:31 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07" returned: 0 in 0.563s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:32 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07 Sep 10 20:10:32 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:32 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-56136925-686b-4fad-8a4e-c73fab0b1b07" returned: 0 in 0.364s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:10:32 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Image download 20.69 MB at 20.69 MB/s Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-56136925-686b-4fad-8a4e-c73fab0b1b07" released by "delete_volume" :: held 1.016s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c46c59-352b-44bd-912e-98434fca9d75]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Created reservations ['ace1b720-dd4c-4e43-b3e2-96c2274ef51d', 'd633c393-c4ec-4b1d-bf0b-a998c95af25c', '4bfb9b41-68a4-4073-bb2f-f43ac8a85df2', '427d9d87-aa3c-44fb-bb6e-ed997a1840ca'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:32 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD Sep 10 20:10:32 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:32 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:32 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:32 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 is fetched for user 1312dce52d564dbcb4cd0bf6fa7154f6. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:10:32 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.317s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:32 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Deleted volume successfully. Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d465da2a-9298-4589-b733-55e7fd98bf33 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-56136925-686b-4fad-8a4e-c73fab0b1b07-delete_volume" released by "delete_volume" :: held 9.229s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b66d085-5add-414a-9b4b-c5e498631455]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:33 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD Sep 10 20:10:33 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:33 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-69817284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95709be9-04c0-447a-b40a-249cb6010b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4708f44ada9841f2918511c97cbcec35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:31Z,use_quota=True,user_id='1312dce52d564dbcb4cd0bf6fa7154f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Creating volume 95709be9-04c0-447a-b40a-249cb6010b3c {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:33 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:33 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c 1073741824 Sep 10 20:10:33 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Flow 'volume_create_manager' (7a15e745-e5b2-41d9-9c59-e5711f868cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749e55c3-6661-43b0-8f19-4a6522f2ef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749e55c3-6661-43b0-8f19-4a6522f2ef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289545509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4906537-06f4-4bf1-9dd4-6759355b5bc7,host='devstack@QuobyteHD#QuobyteHD',id=c58d077a-6f27-473d-a269-49648dc337a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8f917cc21b459a9ca6b62d3e16ee44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:34Z,use_quota=True,user_id='956dcee81e4048e98f3b54f9c902771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8fb2459-fdbc-4f42-b1d2-7216307fb77b),volume_type_id=f8fb2459-fdbc-4f42-b1d2-7216307fb77b)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead84a62-9333-4d33-91f4-c5fdf2c7d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead84a62-9333-4d33-91f4-c5fdf2c7d053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e11bcd0-b4b0-49d5-9a84-9772345e1c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e11bcd0-b4b0-49d5-9a84-9772345e1c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58d077a-6f27-473d-a269-49648dc337a5', 'volume_name': 'volume-c58d077a-6f27-473d-a269-49648dc337a5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e51f46-13b1-4dd2-8862-ea4be2b8cf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e51f46-13b1-4dd2-8862-ea4be2b8cf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c5f55f-8d0a-4ad4-adec-a0138cd7157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:34 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Volume c58d077a-6f27-473d-a269-49648dc337a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58d077a-6f27-473d-a269-49648dc337a5', 'volume_size': 1} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:34 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c 1073741824" returned: 0 in 0.627s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:34 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c Sep 10 20:10:34 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Flow 'volume_create_manager' (b8b28fc8-d4c1-4b60-8b8c-7da3ac49697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a77ec2-a163-4fef-8d74-b34d68f49b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a77ec2-a163-4fef-8d74-b34d68f49b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-444945301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d69cf2-0d55-41a5-88c3-1d51bb8f745b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c55dfe70564375be089c777f2dd0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:34Z,use_quota=True,user_id='1bf3e8600eb745acb3c3073bd0f70cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e866c46b-c8bf-4edc-b7f0-f736c03dcec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e866c46b-c8bf-4edc-b7f0-f736c03dcec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873638a8-cd6f-407c-94d7-8f8902391764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873638a8-cd6f-407c-94d7-8f8902391764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d69cf2-0d55-41a5-88c3-1d51bb8f745b', 'volume_name': 'volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8e5932-900a-4183-b067-85b3958cac04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8e5932-900a-4183-b067-85b3958cac04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1680207b-1bbe-4d3e-8457-d4c6e1b79cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:34 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Volume b5d69cf2-0d55-41a5-88c3-1d51bb8f745b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b', 'volume_size': 1} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:34 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c" returned: 0 in 0.272s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4906537-06f4-4bf1-9dd4-6759355b5bc7,created_at=2026-09-10T18:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289545509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4906537-06f4-4bf1-9dd4-6759355b5bc7,host='devstack@QuobyteHD#QuobyteHD',id=c58d077a-6f27-473d-a269-49648dc337a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8f917cc21b459a9ca6b62d3e16ee44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:34Z,use_quota=True,user_id='956dcee81e4048e98f3b54f9c902771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8fb2459-fdbc-4f42-b1d2-7216307fb77b),volume_type_id=f8fb2459-fdbc-4f42-b1d2-7216307fb77b)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Creating volume c58d077a-6f27-473d-a269-49648dc337a5 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:34 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Attempting download of c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume 95709be9-04c0-447a-b40a-249cb6010b3c. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:10:34 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5 1073741824 Sep 10 20:10:34 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de31687-beca-4d7c-9a18-807a8cc85f80]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_z5zean_q {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:34 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_z5zean_q Sep 10 20:10:34 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:34 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_z5zean_q" returned: 0 in 0.363s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_z5zean_q {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:34 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5 1073741824" returned: 0 in 0.457s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:34 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5 Sep 10 20:10:34 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:34 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_z5zean_q Sep 10 20:10:34 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:35 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5" returned: 0 in 0.296s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-444945301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d69cf2-0d55-41a5-88c3-1d51bb8f745b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c55dfe70564375be089c777f2dd0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:34Z,use_quota=True,user_id='1bf3e8600eb745acb3c3073bd0f70cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Creating volume b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:35 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c5f55f-8d0a-4ad4-adec-a0138cd7157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58d077a-6f27-473d-a269-49648dc337a5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddd3d92-23e4-4a8f-b215-eeab025f6048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:35 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b 1073741824 Sep 10 20:10:35 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:35 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Volume volume-c58d077a-6f27-473d-a269-49648dc337a5 (c58d077a-6f27-473d-a269-49648dc337a5): created successfully Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddd3d92-23e4-4a8f-b215-eeab025f6048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:35 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Flow 'volume_create_manager' (7a15e745-e5b2-41d9-9c59-e5711f868cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_z5zean_q" returned: 1 in 0.436s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_z5zean_q' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c562454a-cde2-43d8-a690-582d9db9c249]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2ee3fca8-fa7c-4ed5-b004-5f0ee8d06584 tempest-GroupsTest-1076866471 None] Created volume successfully. Sep 10 20:10:35 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD Sep 10 20:10:35 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:35 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] c78ee229-c276-4323-b914-d91a23a49bd6 was qcow2, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:35 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b 1073741824" returned: 0 in 0.511s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:35 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c Sep 10 20:10:35 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:35 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b Sep 10 20:10:35 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:35 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1680207b-1bbe-4d3e-8457-d4c6e1b79cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809ed91e-ce2b-47a6-b4f9-71adf099a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:36 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Volume volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b (b5d69cf2-0d55-41a5-88c3-1d51bb8f745b): created successfully Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809ed91e-ce2b-47a6-b4f9-71adf099a640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Flow 'volume_create_manager' (b8b28fc8-d4c1-4b60-8b8c-7da3ac49697d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8c58b13a-5ead-4fb7-a3cd-95273a792f1d tempest-VolumesDeleteCascade-2011900565 None] Created volume successfully. Sep 10 20:10:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e25601f8-7565-4568-aec4-ace18615d96f tempest-GroupsTest-1076866471 None] Update group completed successfully. Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Creating offline snapshot ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 of volume b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4b55fa-9101-44dd-8678-b0c97659f78b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:36 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b Sep 10 20:10:36 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:36 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" returned: 0 in 0.384s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:36 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 1G Sep 10 20:10:36 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:37 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 1G" returned: 0 in 0.422s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:37 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 Sep 10 20:10:37 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:37 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c" returned: 0 in 1.722s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_e65p_vbvdevstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:10:37 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Converted 112.00 MB image at 65.01 MB/s Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:37 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c 1G Sep 10 20:10:37 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:37 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:37 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 is being set with open permissions: ugo+rw Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:37 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 Sep 10 20:10:37 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:37 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c 1G" returned: 0 in 0.388s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Downloaded image c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume 95709be9-04c0-447a-b40a-249cb6010b3c successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 for user 1312dce52d564dbcb4cd0bf6fa7154f6 is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Marking volume 95709be9-04c0-447a-b40a-249cb6010b3c as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:10:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-458db54e-e1f5-42b7-98ea-e4fc77294a3b tempest-GroupsTest-1076866471 None] Update group completed successfully. Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Copying metadata from image c78ee229-c276-4323-b914-d91a23a49bd6 to 95709be9-04c0-447a-b40a-249cb6010b3c. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Creating volume glance metadata for volume 95709be9-04c0-447a-b40a-249cb6010b3c backed by image c78ee229-c276-4323-b914-d91a23a49bd6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:10:37 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f24a8cf-9b7a-4faa-b1a9-67347d4d591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95709be9-04c0-447a-b40a-249cb6010b3c', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38b930a-122d-42f3-8a4c-18bb708fb32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19" returned: 0 in 0.279s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:37 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Volume volume-95709be9-04c0-447a-b40a-249cb6010b3c (95709be9-04c0-447a-b40a-249cb6010b3c): created successfully Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38b930a-122d-42f3-8a4c-18bb708fb32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Flow 'volume_create_manager' (1d00305b-545b-4bbf-ac3f-a765e8540c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c384999e-918c-4fee-902f-a170527c345f tempest-VolumesExtendTest-1449661364 None] Created volume successfully. Sep 10 20:10:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:37 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.info Sep 10 20:10:37 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:38 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.info" returned: 0 in 0.248s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:38 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.info is being set with open permissions: ugo+rw Sep 10 20:10:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:38 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.info Sep 10 20:10:38 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:38 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.info" returned: 0 in 0.232s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-04d8edc0-6b66-45cb-bdb3-926a10c07609 tempest-VolumesDeleteCascade-2011900565 None] Create snapshot completed successfully Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bccb0c4-16b2-4f63-8f10-f723a5a3067d tempest-VolumesExtendTest-1449661364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bccb0c4-16b2-4f63-8f10-f723a5a3067d tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[451d9125-22fb-42e1-af09-50fa49c4548d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bccb0c4-16b2-4f63-8f10-f723a5a3067d tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Flow 'volume_create_manager' (21ccf35c-d0ee-4fbc-b1ca-72b3ac35f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2139b16-c5dd-4507-9bf0-ab95a7b0439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2139b16-c5dd-4507-9bf0-ab95a7b0439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1523957136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74541fb1-151a-4f7f-b9db-c6116057d170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c55dfe70564375be089c777f2dd0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee6c5f73-dc37-499a-9ad0-cfc34bae9b19,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:39Z,use_quota=True,user_id='1bf3e8600eb745acb3c3073bd0f70cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d5a8af-2d15-4cec-a280-e353ae19ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d5a8af-2d15-4cec-a280-e353ae19ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317560fd-b50d-4846-80a0-49d601ada331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317560fd-b50d-4846-80a0-49d601ada331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74541fb1-151a-4f7f-b9db-c6116057d170', 'volume_name': 'volume-74541fb1-151a-4f7f-b9db-c6116057d170', 'volume_size': 1, 'snapshot_id': 'ee6c5f73-dc37-499a-9ad0-cfc34bae9b19'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f15ff9-f748-4070-adc9-889b230f9bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f15ff9-f748-4070-adc9-889b230f9bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955c71fe-4ba2-4879-8caa-a045dea85685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:39 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Volume 74541fb1-151a-4f7f-b9db-c6116057d170: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74541fb1-151a-4f7f-b9db-c6116057d170', 'volume_size': 1, 'snapshot_id': 'ee6c5f73-dc37-499a-9ad0-cfc34bae9b19'} Sep 10 20:10:39 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c Sep 10 20:10:39 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Acquiring lock "cinder-quobyte-c58d077a-6f27-473d-a269-49648dc337a5" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Lock "cinder-quobyte-c58d077a-6f27-473d-a269-49648dc337a5" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb6e6b4-554d-4814-b692-d0ec8effc6ba]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:39 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bccb0c4-16b2-4f63-8f10-f723a5a3067d tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c" returned: 0 in 0.383s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bccb0c4-16b2-4f63-8f10-f723a5a3067d tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c 2G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:39 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5 Sep 10 20:10:39 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bccb0c4-16b2-4f63-8f10-f723a5a3067d tempest-VolumesExtendTest-1449661364 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c 2G" returned: 0 in 0.089s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bccb0c4-16b2-4f63-8f10-f723a5a3067d tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.500s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.362s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-ee6c5f73-dc37-499a-9ad0-cfc34bae9b19-74541fb1-151a-4f7f-b9db-c6116057d170" by "_create_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-ee6c5f73-dc37-499a-9ad0-cfc34bae9b19-74541fb1-151a-4f7f-b9db-c6116057d170" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Creating volume 74541fb1-151a-4f7f-b9db-c6116057d170 from snapshot ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 {{(pid=88137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-74541fb1-151a-4f7f-b9db-c6116057d170" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-74541fb1-151a-4f7f-b9db-c6116057d170" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] snapshot: ee6c5f73-dc37-499a-9ad0-cfc34bae9b19, volume: 74541fb1-151a-4f7f-b9db-c6116057d170, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:10:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5bccb0c4-16b2-4f63-8f10-f723a5a3067d tempest-VolumesExtendTest-1449661364 None] Extend volume completed successfully. Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebba7f95-826a-473c-87e5-b943936339dd]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:39 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5" returned: 0 in 0.390s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:39 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 Sep 10 20:10:39 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:39 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5 Sep 10 20:10:39 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:40 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c58d077a-6f27-473d-a269-49648dc337a5" returned: 0 in 0.243s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Lock "cinder-quobyte-c58d077a-6f27-473d-a269-49648dc337a5" released by "delete_volume" :: held 0.682s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Acquiring lock "cinder-quobyte-e599f2e2-e842-498a-9b13-f5ce0ad90ce0" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:40 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19" returned: 0 in 0.372s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Lock "cinder-quobyte-e599f2e2-e842-498a-9b13-f5ce0ad90ce0" acquired by "delete_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[485e4223-324c-4d75-b848-5f1ba9670e2e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432fda6-b064-474c-ad78-b9af173106cc]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:40 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b Sep 10 20:10:40 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:40 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 Sep 10 20:10:40 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Acquiring lock "cinder-95709be9-04c0-447a-b40a-249cb6010b3c-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Lock "cinder-95709be9-04c0-447a-b40a-249cb6010b3c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Acquiring lock "cinder-quobyte-95709be9-04c0-447a-b40a-249cb6010b3c" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Lock "cinder-quobyte-95709be9-04c0-447a-b40a-249cb6010b3c" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cfd611-9893-4f88-bda4-888b3a9ae6ca]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:40 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" returned: 0 in 0.392s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:40 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0" returned: 0 in 0.406s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:40 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 Sep 10 20:10:40 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:40 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0 Sep 10 20:10:40 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:40 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c Sep 10 20:10:40 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:40 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e599f2e2-e842-498a-9b13-f5ce0ad90ce0" returned: 0 in 0.266s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Lock "cinder-quobyte-e599f2e2-e842-498a-9b13-f5ce0ad90ce0" released by "delete_volume" :: held 0.720s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:40 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c" returned: 0 in 0.371s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:40 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c Sep 10 20:10:40 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Created reservations ['d4eac9b6-6427-4cc5-96fd-230dbc1d5c53'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:40 devstack cinder-volume[88137]: WARNING cinder.quota [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1837209093 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1837209093, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:10:40 devstack cinder-volume[88137]: WARNING cinder.quota [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1837209093 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1837209093, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:10:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Created reservations ['ca96c4b1-7812-4901-8c94-9727cfe030f3', 'e7e01c47-3d46-4841-a709-10c599c290f5', '3a6288fd-69c6-4485-a5eb-92a53724ea64', 'b4217649-bdf6-4e2d-a24e-cc1ebd89e61a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Created reservations ['1d9d2fb5-5b0a-464d-b681-c2ceee03c521', '6a035a41-ec78-4fa6-83a5-d2e14f54e2d2', '35d3b554-10a4-45ff-a843-2ed3d61f253c', '1c86a1a9-ec3e-4eed-b9c1-b8e108b05971'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:41 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-95709be9-04c0-447a-b40a-249cb6010b3c" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Lock "cinder-quobyte-95709be9-04c0-447a-b40a-249cb6010b3c" released by "delete_volume" :: held 0.812s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Created reservations ['dfe9b043-5652-4de8-b3a5-6ec5932e61a9', '0b391ec8-109d-40ca-8166-5d7082cca579', 'c98517eb-ab90-4d15-96e3-11afdaeaf288', '9324430e-d2fe-4d0c-9b19-9544b252c20e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:41 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:41 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:41 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:41 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:42 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.768s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:42 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:42 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-adf71664-9817-452c-8385-4b7fae03b612 tempest-GroupsTest-1076866471 None] Delete group completed successfully. Sep 10 20:10:42 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.934s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:42 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:42 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Deleted volume successfully. Sep 10 20:10:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-14472ef0-bbad-442f-a410-7d4b16bbcc6c tempest-VolumesExtendTest-1449661364 None] Lock "cinder-95709be9-04c0-447a-b40a-249cb6010b3c-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Flow 'volume_create_manager' (c84e40ce-4551-47b2-81ce-a46ffb9f7b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e72194d-0d4a-4bab-9081-8fd01a8fc81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e72194d-0d4a-4bab-9081-8fd01a8fc81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-755648876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99eaea45-f977-4829-be59-bcc0dca41f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4708f44ada9841f2918511c97cbcec35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:44Z,use_quota=True,user_id='1312dce52d564dbcb4cd0bf6fa7154f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03494fd5-0fdb-4d2e-94df-0ab56abbfdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03494fd5-0fdb-4d2e-94df-0ab56abbfdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02d1351-5a71-4798-8f4b-f5054d6c311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02d1351-5a71-4798-8f4b-f5054d6c311b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99eaea45-f977-4829-be59-bcc0dca41f58', 'volume_name': 'volume-99eaea45-f977-4829-be59-bcc0dca41f58', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2298c5a1-79bf-4789-9a1d-c7a2d8c6e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2298c5a1-79bf-4789-9a1d-c7a2d8c6e13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c38e5b-59ef-4c3f-84de-fefd2d3199a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:44 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Volume 99eaea45-f977-4829-be59-bcc0dca41f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99eaea45-f977-4829-be59-bcc0dca41f58', 'volume_size': 1} Sep 10 20:10:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:46 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170" returned: 0 in 6.059s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:10:46 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Converted 1024.00 MB image at 168.99 MB/s Sep 10 20:10:46 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 is being set with open permissions: ugo+rw Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:46 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 Sep 10 20:10:46 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:46 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170" returned: 0 in 0.270s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-74541fb1-151a-4f7f-b9db-c6116057d170" released by "_copy_volume_from_snapshot" :: held 7.199s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-ee6c5f73-dc37-499a-9ad0-cfc34bae9b19-74541fb1-151a-4f7f-b9db-c6116057d170" released by "_create_volume_from_snapshot" :: held 7.303s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.331s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.441s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-755648876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99eaea45-f977-4829-be59-bcc0dca41f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4708f44ada9841f2918511c97cbcec35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:44Z,use_quota=True,user_id='1312dce52d564dbcb4cd0bf6fa7154f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Creating volume 99eaea45-f977-4829-be59-bcc0dca41f58 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:46 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:47 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 1073741824 Sep 10 20:10:47 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955c71fe-4ba2-4879-8caa-a045dea85685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74541fb1-151a-4f7f-b9db-c6116057d170', 'volume_size': 1, 'snapshot_id': 'ee6c5f73-dc37-499a-9ad0-cfc34bae9b19'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091fc47f-3ed3-4dc6-b9ec-495ed23059c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:47 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Volume volume-74541fb1-151a-4f7f-b9db-c6116057d170 (74541fb1-151a-4f7f-b9db-c6116057d170): created successfully Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091fc47f-3ed3-4dc6-b9ec-495ed23059c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Flow 'volume_create_manager' (21ccf35c-d0ee-4fbc-b1ca-72b3ac35f50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:47 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-71a97032-0f39-441d-92da-ded7daf5a986 tempest-VolumesDeleteCascade-2011900565 None] Created volume successfully. Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Flow 'volume_create_manager' (af1c8cbb-b7f4-43c0-90fc-6f16062f1054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8e5975-90f7-471d-93b3-2a6e08166ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8e5975-90f7-471d-93b3-2a6e08166ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-342919858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9aa24c-973d-4be0-87f5-3dd88ce766dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c568403933f9484db8f515abeaee7356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:47Z,use_quota=True,user_id='fdd58a62142c45fba3b13a1f1b8e23a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aef5fcb-5088-4142-9c12-7f2aa0aebe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aef5fcb-5088-4142-9c12-7f2aa0aebe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8829f9-00f3-467d-acd9-f299fcb52fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8829f9-00f3-467d-acd9-f299fcb52fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a9aa24c-973d-4be0-87f5-3dd88ce766dd', 'volume_name': 'volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfaadd76-279d-4933-9818-91071a2686f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfaadd76-279d-4933-9818-91071a2686f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537c0c1a-5f88-44da-af9d-33297895b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:47 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Volume 8a9aa24c-973d-4be0-87f5-3dd88ce766dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd', 'volume_size': 1} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Performing cascade delete. {{(pid=88137) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-ee6c5f73-dc37-499a-9ad0-cfc34bae9b19-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-ee6c5f73-dc37-499a-9ad0-cfc34bae9b19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-ee6c5f73-dc37-499a-9ad0-cfc34bae9b19" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-ee6c5f73-dc37-499a-9ad0-cfc34bae9b19" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Deleting offline snapshot ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 of volume b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] snapshot_file for this snap is: volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6587eb62-e951-4109-b085-569373be23ad]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:47 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 1073741824" returned: 0 in 0.612s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:47 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 Sep 10 20:10:47 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:47 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 Sep 10 20:10:47 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:47 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58" returned: 0 in 0.258s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-342919858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9aa24c-973d-4be0-87f5-3dd88ce766dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c568403933f9484db8f515abeaee7356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:10:47Z,use_quota=True,user_id='fdd58a62142c45fba3b13a1f1b8e23a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Creating volume 8a9aa24c-973d-4be0-87f5-3dd88ce766dd {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:10:47 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=119,cinder:INSERT=40,cinder:UPDATE=152,cinder:DELETE=11 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c38e5b-59ef-4c3f-84de-fefd2d3199a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99eaea45-f977-4829-be59-bcc0dca41f58', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:47 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:47 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd 1073741824 Sep 10 20:10:47 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310e5df3-b922-43aa-847b-90445d86fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19" returned: 0 in 0.406s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:10:47 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Volume volume-99eaea45-f977-4829-be59-bcc0dca41f58 (99eaea45-f977-4829-be59-bcc0dca41f58): created successfully Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310e5df3-b922-43aa-847b-90445d86fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Flow 'volume_create_manager' (c84e40ce-4551-47b2-81ce-a46ffb9f7b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[988b86da-affa-49ec-9c49-bf44cccdb245]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-43d3748a-aecb-4a2d-a4cf-9b0e707e1b1b tempest-VolumesExtendTest-1449661364 None] Created volume successfully. Sep 10 20:10:48 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b Sep 10 20:10:48 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:48 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd 1073741824" returned: 0 in 0.515s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:48 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd Sep 10 20:10:48 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:48 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" returned: 0 in 0.597s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:48 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 Sep 10 20:10:48 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:48 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd" returned: 0 in 0.339s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537c0c1a-5f88-44da-af9d-33297895b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52de2d1-7120-484d-b952-c45c1a063678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Creating offline snapshot cbe109d3-2aa6-450d-8e0b-224a081c3fed of volume 99eaea45-f977-4829-be59-bcc0dca41f58 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:10:48 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Volume volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd (8a9aa24c-973d-4be0-87f5-3dd88ce766dd): created successfully Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52de2d1-7120-484d-b952-c45c1a063678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Flow 'volume_create_manager' (af1c8cbb-b7f4-43c0-90fc-6f16062f1054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[34395676-ecf0-45cb-85f1-fd7fcceddeb1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9422fa28-9197-4e12-97bc-f9f951048de5 tempest-AttachVolumeTestJSON-1498965026 None] Created volume successfully. Sep 10 20:10:49 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19" returned: 0 in 0.413s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:49 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 Sep 10 20:10:49 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19 Sep 10 20:10:49 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:49 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:49 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b.ee6c5f73-dc37-499a-9ad0-cfc34bae9b19" returned: 0 in 0.311s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:49 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58" returned: 0 in 0.464s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-ee6c5f73-dc37-499a-9ad0-cfc34bae9b19" released by "_delete_snapshot" :: held 1.867s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" released by "delete_snapshot" :: held 1.901s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:49 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed 1G Sep 10 20:10:49 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Created reservations ['3afbcdeb-595e-4fd1-9a3a-b49e246f1dae', 'a7ab1b2f-de4c-4a2d-aee3-7ccb7dffbb5b', '3b78e4a2-2e1d-4be6-a15d-167227b84d43', '25db8f05-e3bb-4320-85e9-037857259645'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Delete snapshot completed successfully. Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-ee6c5f73-dc37-499a-9ad0-cfc34bae9b19-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Snapshots deleted, issuing volume delete {{(pid=88137) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a37d0-93e6-422c-a54c-61067e96e204]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:49 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b Sep 10 20:10:49 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:50 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed 1G" returned: 0 in 0.635s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99eaea45-f977-4829-be59-bcc0dca41f58 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:50 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99eaea45-f977-4829-be59-bcc0dca41f58 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed Sep 10 20:10:50 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:50 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" returned: 0 in 0.605s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-fd5fdb26-e191-44e1-a80f-717e92f42e1c req-7540350f-f828-42cf-8790-9311e6b09206 tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:50 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b Sep 10 20:10:50 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:50 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99eaea45-f977-4829-be59-bcc0dca41f58 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed" returned: 0 in 0.458s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:50 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed is being set with open permissions: ugo+rw Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:50 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed Sep 10 20:10:50 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:50 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" returned: 0 in 0.316s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b" released by "delete_volume" :: held 1.025s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Created reservations ['e986cee0-e760-4612-9b37-e51761daae6e', '0b48acee-e25d-466c-99ea-a6787a2b17ad', '45e78197-664e-45fd-8fd5-ddcc8ad99498', '8de447da-5737-46e0-adc5-f7971a3d8b62'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:50 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed" returned: 0 in 0.311s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:50 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:50 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:50 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.info Sep 10 20:10:50 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:51 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.317s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Deleted volume successfully. Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-68ecdf25-ca0a-4c4d-a259-2e01423c618c tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-b5d69cf2-0d55-41a5-88c3-1d51bb8f745b-delete_volume" released by "delete_volume" :: held 3.724s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:51 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.info" returned: 0 in 0.308s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:51 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.info is being set with open permissions: ugo+rw Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:51 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.info Sep 10 20:10:51 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:51 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.info" returned: 0 in 0.245s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-fd5fdb26-e191-44e1-a80f-717e92f42e1c req-7540350f-f828-42cf-8790-9311e6b09206 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.123s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-fd5fdb26-e191-44e1-a80f-717e92f42e1c req-7540350f-f828-42cf-8790-9311e6b09206 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0e4011cd-b7ce-4bf5-ad24-4b6905de7951 tempest-VolumesExtendTest-1449661364 None] Create snapshot completed successfully Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-fd5fdb26-e191-44e1-a80f-717e92f42e1c req-7540350f-f828-42cf-8790-9311e6b09206 tempest-AttachVolumeTestJSON-1498965026 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71ac9416-853f-4aa5-ae03-6d57af912b6c', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:10:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-fd5fdb26-e191-44e1-a80f-717e92f42e1c req-7540350f-f828-42cf-8790-9311e6b09206 tempest-AttachVolumeTestJSON-1498965026 None] attachment_update completed successfully. Sep 10 20:10:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-172e7d8a-cff7-43ec-8af2-588d370319db tempest-GroupsV320Test-24081753 None] Group tempest-GroupsV320Test-Group-1780681211: creating Sep 10 20:10:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-172e7d8a-cff7-43ec-8af2-588d370319db tempest-GroupsV320Test-24081753 None] Group tempest-GroupsV320Test-Group-1780681211: created successfully Sep 10 20:10:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-172e7d8a-cff7-43ec-8af2-588d370319db tempest-GroupsV320Test-24081753 None] Create group completed successfully. Sep 10 20:10:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-74541fb1-151a-4f7f-b9db-c6116057d170-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-74541fb1-151a-4f7f-b9db-c6116057d170-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "cinder-quobyte-74541fb1-151a-4f7f-b9db-c6116057d170" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-74541fb1-151a-4f7f-b9db-c6116057d170" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[361dab1f-b5ad-402b-9720-994226bac2d2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d6c6c3fd-6ddb-4b47-8692-1416fe6a4bf4 tempest-VolumesExtendTest-1449661364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d6c6c3fd-6ddb-4b47-8692-1416fe6a4bf4 tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3662ad5-288a-4d38-93f2-c39c6f79d457]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d6c6c3fd-6ddb-4b47-8692-1416fe6a4bf4 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:52 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 Sep 10 20:10:52 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:52 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 Sep 10 20:10:52 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:52 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170" returned: 0 in 0.409s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:52 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170 Sep 10 20:10:52 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:52 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d6c6c3fd-6ddb-4b47-8692-1416fe6a4bf4 tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58" returned: 0 in 0.419s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d6c6c3fd-6ddb-4b47-8692-1416fe6a4bf4 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed 2G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:52 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74541fb1-151a-4f7f-b9db-c6116057d170" returned: 0 in 0.266s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d6c6c3fd-6ddb-4b47-8692-1416fe6a4bf4 tempest-VolumesExtendTest-1449661364 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed 2G" returned: 0 in 0.126s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d6c6c3fd-6ddb-4b47-8692-1416fe6a4bf4 tempest-VolumesExtendTest-1449661364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.581s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-quobyte-74541fb1-151a-4f7f-b9db-c6116057d170" released by "delete_volume" :: held 0.734s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:52 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d6c6c3fd-6ddb-4b47-8692-1416fe6a4bf4 tempest-VolumesExtendTest-1449661364 None] Extend volume completed successfully. Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Created reservations ['d5fded4a-5a0a-4b4c-a090-8c710f4d4863', '26fccc64-994f-416b-a83c-646e5cd8029f', '11f2a65b-b447-4001-a245-69f2b3745311', 'af0522a6-b4d5-4fe3-b964-38c38b289a85'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:52 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:52 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:53 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.261s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Deleted volume successfully. Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1d672f66-2e06-4557-a0df-56a890ed3e08 tempest-VolumesDeleteCascade-2011900565 None] Lock "cinder-74541fb1-151a-4f7f-b9db-c6116057d170-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] Created reservations ['ff6e73ee-726e-4ba3-8aa8-91f710cc5956'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Acquiring lock "cinder-cbe109d3-2aa6-450d-8e0b-224a081c3fed-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Lock "cinder-cbe109d3-2aa6-450d-8e0b-224a081c3fed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Acquiring lock "cinder-quobyte-99eaea45-f977-4829-be59-bcc0dca41f58" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Lock "cinder-quobyte-99eaea45-f977-4829-be59-bcc0dca41f58" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Acquiring lock "cinder-quobyte-cbe109d3-2aa6-450d-8e0b-224a081c3fed" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Lock "cinder-quobyte-cbe109d3-2aa6-450d-8e0b-224a081c3fed" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:53 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:53 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Deleting offline snapshot cbe109d3-2aa6-450d-8e0b-224a081c3fed of volume 99eaea45-f977-4829-be59-bcc0dca41f58 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] snapshot_file for this snap is: volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[42581a7a-c606-4db1-a144-ea8317a81541]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:53 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed Sep 10 20:10:53 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:53 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.376s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:53 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1d1ebbf0-273a-43ac-8399-3576fc73fdfc tempest-GroupsV320Test-24081753 None] Delete group completed successfully. Sep 10 20:10:54 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed" returned: 0 in 0.523s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99eaea45-f977-4829-be59-bcc0dca41f58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:10:54 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37b38c6-b7dc-4783-9cad-e914315fdbbb]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:54 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 Sep 10 20:10:54 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:54 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58" returned: 0 in 0.407s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:54 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed Sep 10 20:10:54 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:55 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed" returned: 0 in 0.466s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:55 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed Sep 10 20:10:55 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:55 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58.cbe109d3-2aa6-450d-8e0b-224a081c3fed" returned: 0 in 0.342s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Lock "cinder-quobyte-cbe109d3-2aa6-450d-8e0b-224a081c3fed" released by "_delete_snapshot" :: held 1.936s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Lock "cinder-quobyte-99eaea45-f977-4829-be59-bcc0dca41f58" released by "delete_snapshot" :: held 2.012s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:55 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Created reservations ['ad9bcc30-ba42-47d6-9f9b-ec20a4fa361f', '84cd70db-1d58-4f85-b043-733bd59a9e36', '4b5c8420-4ecc-4a6f-aa6a-1dd0224b20dd', 'bc8b71d7-6a07-4ef3-8c5c-1adda1e7468e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:55 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Delete snapshot completed successfully. Sep 10 20:10:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a1777483-87a4-4e35-a541-c2dd9989f060 tempest-VolumesExtendTest-1449661364 None] Lock "cinder-cbe109d3-2aa6-450d-8e0b-224a081c3fed-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Acquiring lock "cinder-99eaea45-f977-4829-be59-bcc0dca41f58-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Lock "cinder-99eaea45-f977-4829-be59-bcc0dca41f58-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Acquiring lock "cinder-quobyte-99eaea45-f977-4829-be59-bcc0dca41f58" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:10:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Lock "cinder-quobyte-99eaea45-f977-4829-be59-bcc0dca41f58" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:10:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef30a1-8723-44ec-ac65-67bd3b9550e2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:10:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:57 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 Sep 10 20:10:57 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:57 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58" returned: 0 in 0.670s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:57 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58 Sep 10 20:10:57 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:58 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99eaea45-f977-4829-be59-bcc0dca41f58" returned: 0 in 0.440s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Lock "cinder-quobyte-99eaea45-f977-4829-be59-bcc0dca41f58" released by "delete_volume" :: held 1.232s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:10:58 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Created reservations ['3415a79a-9844-48bd-8cae-0a972822abb0', 'edc62052-08f4-4392-841d-60bcaa7838c4', '14ba6a49-dce4-40cc-8188-04fe2739317a', '42a2bcf7-85a5-4282-8a4d-76a88858b46c'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:10:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:10:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:10:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:10:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:10:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:10:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:10:58 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:10:58 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:10:59 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 10 20:10:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.540s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:10:59 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:10:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Deleted volume successfully. Sep 10 20:10:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77fe68ff-7002-4bc7-8633-b9435add225b tempest-VolumesExtendTest-1449661364 None] Lock "cinder-99eaea45-f977-4829-be59-bcc0dca41f58-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:01 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Flow 'volume_create_manager' (ea322171-4ff7-45a5-89de-054421082a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a075fd-9844-48c6-a437-a4e01e3e23c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a075fd-9844-48c6-a437-a4e01e3e23c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-622586616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc969329-34d4-4234-b3d3-74de48986d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99a3cf12ff34b5ebcf6e0bc2890fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:02Z,use_quota=True,user_id='a9a82d8fd1c2411ca765236de02cdac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af154746-a3a3-4ccc-acd2-bbb4be5ef099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af154746-a3a3-4ccc-acd2-bbb4be5ef099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700a74af-3ada-4bd6-9338-e305499e7b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700a74af-3ada-4bd6-9338-e305499e7b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc969329-34d4-4234-b3d3-74de48986d19', 'volume_name': 'volume-cc969329-34d4-4234-b3d3-74de48986d19', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3952d57f-c11a-4d4b-8f1d-8707d6db9a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3952d57f-c11a-4d4b-8f1d-8707d6db9a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76b47e6-b629-4d62-848e-6c7f5b551a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:02 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Volume cc969329-34d4-4234-b3d3-74de48986d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc969329-34d4-4234-b3d3-74de48986d19', 'volume_size': 1} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-622586616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc969329-34d4-4234-b3d3-74de48986d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99a3cf12ff34b5ebcf6e0bc2890fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:02Z,use_quota=True,user_id='a9a82d8fd1c2411ca765236de02cdac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Creating volume cc969329-34d4-4234-b3d3-74de48986d19 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:02 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:02 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19 1073741824 Sep 10 20:11:02 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:02 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19 1073741824" returned: 0 in 0.616s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:02 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19 Sep 10 20:11:02 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:03 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19" returned: 0 in 0.357s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76b47e6-b629-4d62-848e-6c7f5b551a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc969329-34d4-4234-b3d3-74de48986d19', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdde4235-6c87-4744-a9f5-c3b4dfef083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:03 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Volume volume-cc969329-34d4-4234-b3d3-74de48986d19 (cc969329-34d4-4234-b3d3-74de48986d19): created successfully Sep 10 20:11:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdde4235-6c87-4744-a9f5-c3b4dfef083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Flow 'volume_create_manager' (ea322171-4ff7-45a5-89de-054421082a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:03 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-de418738-54b4-471a-b0eb-50dd128650f3 tempest-VolumesTransfersV357Test-754598538 None] Created volume successfully. Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (c039d0b7-f463-404f-8a27-0bb515ca6e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d3964e-88d0-44aa-a0fc-86d02b3b2c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d3964e-88d0-44aa-a0fc-86d02b3b2c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2002364704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf542a8c-dfe7-4c39-8693-8f8eccc7d610,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:05Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214d102f-90ed-4ea6-9192-4e926b3df2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214d102f-90ed-4ea6-9192-4e926b3df2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c798f157-6357-436a-ae39-35ae6ce251ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c798f157-6357-436a-ae39-35ae6ce251ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf542a8c-dfe7-4c39-8693-8f8eccc7d610', 'volume_name': 'volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f835eea-6616-4b7e-b9cb-daa446208b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f835eea-6616-4b7e-b9cb-daa446208b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6617ea0-461d-4bb5-87ba-6d0c8bb94ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:04 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Volume bf542a8c-dfe7-4c39-8693-8f8eccc7d610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610', 'volume_size': 1} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2002364704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf542a8c-dfe7-4c39-8693-8f8eccc7d610,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:05Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Creating volume bf542a8c-dfe7-4c39-8693-8f8eccc7d610 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:04 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:04 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 1073741824 Sep 10 20:11:04 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:05 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-efe7548b-e018-479a-b282-7a23fcc9f012 tempest-VolumesTransfersV357Test-1562515781 None] Transfer volume completed successfully. Sep 10 20:11:05 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 1073741824" returned: 0 in 0.589s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:05 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 Sep 10 20:11:05 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:05 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610" returned: 0 in 0.342s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6617ea0-461d-4bb5-87ba-6d0c8bb94ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93277861-0cce-45a3-ba36-59666c050a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:05 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Volume volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 (bf542a8c-dfe7-4c39-8693-8f8eccc7d610): created successfully Sep 10 20:11:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93277861-0cce-45a3-ba36-59666c050a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (c039d0b7-f463-404f-8a27-0bb515ca6e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:06 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c21e17f9-ddc4-4a9e-87db-6e921a7e2b45 tempest-VolumesGetTest-171973747 None] Created volume successfully. Sep 10 20:11:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Acquiring lock "cinder-cc969329-34d4-4234-b3d3-74de48986d19-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Lock "cinder-cc969329-34d4-4234-b3d3-74de48986d19-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Acquiring lock "cinder-quobyte-cc969329-34d4-4234-b3d3-74de48986d19" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Lock "cinder-quobyte-cc969329-34d4-4234-b3d3-74de48986d19" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:06 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5e7fa3-86d0-4e1c-b783-84970e17cc1f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:06 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19 Sep 10 20:11:06 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:06 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19" returned: 0 in 0.428s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:06 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19 Sep 10 20:11:06 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:07 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cc969329-34d4-4234-b3d3-74de48986d19" returned: 0 in 0.310s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Lock "cinder-quobyte-cc969329-34d4-4234-b3d3-74de48986d19" released by "delete_volume" :: held 0.787s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Created reservations ['7a5873ed-6174-4408-8435-b524db0a3f94', '41c3c589-c541-47e7-bf9a-1ad9c2645ddf', '2e0c34c2-7798-4772-8bc7-f09f6a154f01', 'c82e3271-0bb0-4800-8bdd-50f07cec9588'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:07 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:07 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:07 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.323s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Deleted volume successfully. Sep 10 20:11:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95aa4321-4308-45a5-8586-d8d795ab09bc tempest-VolumesTransfersV357Test-596324371 None] Lock "cinder-cc969329-34d4-4234-b3d3-74de48986d19-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (a291e10e-243a-438d-8089-72995903c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477ecd4-99fa-438a-86f3-3c13067645c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a477ecd4-99fa-438a-86f3-3c13067645c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-27604943',display_name='tempest-VolumesGetTest-Volume-656339744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de4ff41-7522-49d6-85b6-95f290ebb7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:08Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1306dd4-b196-4875-80dd-68eb370a7673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1306dd4-b196-4875-80dd-68eb370a7673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20dd8dcd-c425-43af-ae4a-7eba68e15d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20dd8dcd-c425-43af-ae4a-7eba68e15d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de4ff41-7522-49d6-85b6-95f290ebb7c4', 'volume_name': 'volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67279a97-ac0b-4ec8-b63f-9fe6fcfc2592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67279a97-ac0b-4ec8-b63f-9fe6fcfc2592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e427f649-eda0-4aba-ba26-f7c4cbadc2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Volume 9de4ff41-7522-49d6-85b6-95f290ebb7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4', 'volume_size': 1} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-27604943',display_name='tempest-VolumesGetTest-Volume-656339744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de4ff41-7522-49d6-85b6-95f290ebb7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:08Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Creating volume 9de4ff41-7522-49d6-85b6-95f290ebb7c4 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:08 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:08 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 1073741824 Sep 10 20:11:08 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Flow 'volume_create_manager' (e7c26191-cdb8-4193-961a-51a5e29cb2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c266eca-72ca-46db-85aa-218b1724ea5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c266eca-72ca-46db-85aa-218b1724ea5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-92783920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9cacdd-d79b-41ee-b7bc-655c76101229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99a3cf12ff34b5ebcf6e0bc2890fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:09Z,use_quota=True,user_id='a9a82d8fd1c2411ca765236de02cdac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cb1c24-dc21-4840-a19e-0114b1d463a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cb1c24-dc21-4840-a19e-0114b1d463a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87422be2-4140-4e26-926f-9030f3f302f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87422be2-4140-4e26-926f-9030f3f302f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9cacdd-d79b-41ee-b7bc-655c76101229', 'volume_name': 'volume-cd9cacdd-d79b-41ee-b7bc-655c76101229', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05be1609-c0de-4d0c-a219-ba9ab2beef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05be1609-c0de-4d0c-a219-ba9ab2beef4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62171e3-8124-4166-b084-91fe81745897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:08 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Volume cd9cacdd-d79b-41ee-b7bc-655c76101229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9cacdd-d79b-41ee-b7bc-655c76101229', 'volume_size': 1} Sep 10 20:11:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:09 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 1073741824" returned: 0 in 0.555s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:09 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 Sep 10 20:11:09 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:09 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4" returned: 0 in 0.302s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-92783920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9cacdd-d79b-41ee-b7bc-655c76101229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99a3cf12ff34b5ebcf6e0bc2890fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:09Z,use_quota=True,user_id='a9a82d8fd1c2411ca765236de02cdac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Creating volume cd9cacdd-d79b-41ee-b7bc-655c76101229 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:09 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:09 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 1073741824 Sep 10 20:11:09 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e427f649-eda0-4aba-ba26-f7c4cbadc2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b148f1-837c-44f6-bb2b-b9aedd66b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:09 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Volume volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 (9de4ff41-7522-49d6-85b6-95f290ebb7c4): created successfully Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b148f1-837c-44f6-bb2b-b9aedd66b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (a291e10e-243a-438d-8089-72995903c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:09 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6f1d411a-64e0-40ca-80ff-f6206ec8dd6f tempest-VolumesGetTest-171973747 None] Created volume successfully. Sep 10 20:11:10 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 1073741824" returned: 0 in 0.511s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:10 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 Sep 10 20:11:10 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-9de4ff41-7522-49d6-85b6-95f290ebb7c4-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Lock "cinder-9de4ff41-7522-49d6-85b6-95f290ebb7c4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:10 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229" returned: 0 in 0.388s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62171e3-8124-4166-b084-91fe81745897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9cacdd-d79b-41ee-b7bc-655c76101229', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22200dbe-7c08-4835-befd-0f0d7204fb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:10 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Volume volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 (cd9cacdd-d79b-41ee-b7bc-655c76101229): created successfully Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22200dbe-7c08-4835-befd-0f0d7204fb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Flow 'volume_create_manager' (e7c26191-cdb8-4193-961a-51a5e29cb2cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:10 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6c91e8ee-607d-4b88-9074-b260125201c3 tempest-VolumesTransfersV357Test-754598538 None] Created volume successfully. Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-quobyte-9de4ff41-7522-49d6-85b6-95f290ebb7c4" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-9de4ff41-7522-49d6-85b6-95f290ebb7c4" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f16f8-a470-4ae3-8b0d-485810f9a4dc]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:10 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 Sep 10 20:11:10 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:11 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4" returned: 0 in 0.475s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:11 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4 Sep 10 20:11:11 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:11 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9de4ff41-7522-49d6-85b6-95f290ebb7c4" returned: 0 in 0.366s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-9de4ff41-7522-49d6-85b6-95f290ebb7c4" released by "delete_volume" :: held 0.900s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Created reservations ['0817d0e2-ae9f-4b5f-9042-d634e202850e', 'f4bf336e-0dee-433a-b13e-f78c7c514cc8', 'd3da55ed-7507-47d7-95fa-5ec602a64203', 'b96352d8-7df7-4174-9ef9-656870353c12'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:11 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:11 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Acquiring lock "cinder-cd9cacdd-d79b-41ee-b7bc-655c76101229-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Lock "cinder-cd9cacdd-d79b-41ee-b7bc-655c76101229-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Acquiring lock "cinder-quobyte-cd9cacdd-d79b-41ee-b7bc-655c76101229" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Lock "cinder-quobyte-cd9cacdd-d79b-41ee-b7bc-655c76101229" acquired by "delete_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d617578b-b1f6-4ad8-8ff8-ee0ced496d79]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:12 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.391s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Deleted volume successfully. Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-63f6912d-d1ee-4e4f-afab-2874830bacb5 tempest-VolumesGetTest-171973747 None] Lock "cinder-9de4ff41-7522-49d6-85b6-95f290ebb7c4-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:12 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 Sep 10 20:11:12 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:12 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229" returned: 0 in 0.427s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:12 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229 Sep 10 20:11:12 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:12 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cd9cacdd-d79b-41ee-b7bc-655c76101229" returned: 0 in 0.310s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Lock "cinder-quobyte-cd9cacdd-d79b-41ee-b7bc-655c76101229" released by "delete_volume" :: held 0.800s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-bf542a8c-dfe7-4c39-8693-8f8eccc7d610-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Lock "cinder-bf542a8c-dfe7-4c39-8693-8f8eccc7d610-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:12 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Created reservations ['61105bf1-b9fd-49a4-b062-f9087ae82e0d', 'e51e263a-a676-475e-8efa-be9a0724133e', '3805ae36-1edb-4e82-bc5b-6d4c9a4fc241', 'e09ccf9b-f78e-4e84-8f67-82eb59021938'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-quobyte-bf542a8c-dfe7-4c39-8693-8f8eccc7d610" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-bf542a8c-dfe7-4c39-8693-8f8eccc7d610" acquired by "delete_volume" :: waited 0.042s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75344ec-3d54-4eec-8f35-847e341cb4ee]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:13 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:13 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:13 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 Sep 10 20:11:13 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:13 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.335s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:13 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Deleted volume successfully. Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ab7f4e74-21c7-4841-a7b6-48f0a4c44d47 tempest-VolumesTransfersV357Test-596324371 None] Lock "cinder-cd9cacdd-d79b-41ee-b7bc-655c76101229-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:13 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610" returned: 0 in 0.461s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:13 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610 Sep 10 20:11:13 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:13 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-bf542a8c-dfe7-4c39-8693-8f8eccc7d610" returned: 0 in 0.301s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-bf542a8c-dfe7-4c39-8693-8f8eccc7d610" released by "delete_volume" :: held 0.820s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:13 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Created reservations ['1da1662e-e84b-4642-a232-b7c20b4edabf', 'c8fc9042-5dae-4afc-849e-aed27ab315a4', 'c4ea7df9-dbf8-4e50-86a9-2409f7edb981', 'eeb7e416-b2b9-4ca2-af54-876dd0d87453'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:14 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:14 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:14 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.278s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Deleted volume successfully. Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11143064-a9ab-4722-aa17-a2b31b46e354 tempest-VolumesGetTest-171973747 None] Lock "cinder-bf542a8c-dfe7-4c39-8693-8f8eccc7d610-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (2d76d90e-5297-4b46-9f7e-1f187c2c0588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac773456-75f9-4421-aa9d-d652455a9891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac773456-75f9-4421-aa9d-d652455a9891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-672151598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab993f98-77d3-45e6-959a-ee4096d54557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:15Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7a9be1-1bed-416c-8628-220950bd9f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7a9be1-1bed-416c-8628-220950bd9f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad740e3b-d4fc-4de6-ba11-31bc8da8e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad740e3b-d4fc-4de6-ba11-31bc8da8e40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab993f98-77d3-45e6-959a-ee4096d54557', 'volume_name': 'volume-ab993f98-77d3-45e6-959a-ee4096d54557', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15078198-7cb5-47b2-a094-50a2bec1f139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15078198-7cb5-47b2-a094-50a2bec1f139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0334ce19-efd8-48e4-ab9b-c07c36452c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:14 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Volume ab993f98-77d3-45e6-959a-ee4096d54557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab993f98-77d3-45e6-959a-ee4096d54557', 'volume_size': 1} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-672151598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab993f98-77d3-45e6-959a-ee4096d54557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:15Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Creating volume ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:14 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:14 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 1073741824 Sep 10 20:11:14 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:15 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 1073741824" returned: 0 in 0.606s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:15 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 Sep 10 20:11:15 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:15 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557" returned: 0 in 0.254s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0334ce19-efd8-48e4-ab9b-c07c36452c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab993f98-77d3-45e6-959a-ee4096d54557', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cc0141-2e8d-4c84-9d0b-970ef7c84e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:15 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Volume volume-ab993f98-77d3-45e6-959a-ee4096d54557 (ab993f98-77d3-45e6-959a-ee4096d54557): created successfully Sep 10 20:11:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cc0141-2e8d-4c84-9d0b-970ef7c84e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (2d76d90e-5297-4b46-9f7e-1f187c2c0588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:15 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4c1687a3-4e1a-492f-b4fb-fdf8751dcb88 tempest-VolumesGetTest-171973747 None] Created volume successfully. Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (e3ae7b66-7be5-4c36-a61c-a9638fec7a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2424bbcf-00d0-46e9-9987-8c34d4a07471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2424bbcf-00d0-46e9-9987-8c34d4a07471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-312809735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5854d4-6a47-45ee-a300-59f00e4f8c9c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ab993f98-77d3-45e6-959a-ee4096d54557,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:17Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ad37f2-8417-449d-bd49-147dfa687d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ad37f2-8417-449d-bd49-147dfa687d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1883f55b-3c11-4ed3-a0cd-2fb381b670fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1883f55b-3c11-4ed3-a0cd-2fb381b670fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8c5854d4-6a47-45ee-a300-59f00e4f8c9c', 'volume_name': 'volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c', 'volume_size': 1, 'source_volid': 'ab993f98-77d3-45e6-959a-ee4096d54557', 'source_volstatus': 'available'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd482b10-a56e-4917-862b-76d3480b509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd482b10-a56e-4917-862b-76d3480b509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf095b8-b80e-4d5d-be45-603c7c7d4922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:17 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Volume 8c5854d4-6a47-45ee-a300-59f00e4f8c9c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c', 'volume_size': 1, 'source_volid': 'ab993f98-77d3-45e6-959a-ee4096d54557', 'source_volstatus': 'available'} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:17 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Cloning volume ab993f98-77d3-45e6-959a-ee4096d54557 to volume 8c5854d4-6a47-45ee-a300-59f00e4f8c9c Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Creating offline snapshot a73dcdfa-7c2e-4952-9938-7843a79100ac of volume ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2765a1b-97b0-443b-9562-c7d8881ecd5c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:17 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 Sep 10 20:11:17 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:18 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557" returned: 0 in 0.473s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:18 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac 1G Sep 10 20:11:18 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:18 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac 1G" returned: 0 in 0.685s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab993f98-77d3-45e6-959a-ee4096d54557 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:18 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab993f98-77d3-45e6-959a-ee4096d54557 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac Sep 10 20:11:18 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:19 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab993f98-77d3-45e6-959a-ee4096d54557 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac" returned: 0 in 0.653s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:19 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac is being set with open permissions: ugo+rw Sep 10 20:11:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:19 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac Sep 10 20:11:19 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:19 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac" returned: 0 in 0.359s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:19 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.info Sep 10 20:11:19 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:20 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.info" returned: 0 in 0.433s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:20 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.info is being set with open permissions: ugo+rw Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:20 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.info Sep 10 20:11:20 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:20 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:20 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:20 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.292s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 28 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:11:20 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.info" returned: 0 in 0.437s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-quobyte-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] snapshot: a73dcdfa-7c2e-4952-9938-7843a79100ac, volume: 8c5854d4-6a47-45ee-a300-59f00e4f8c9c, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=159,cinder:UPDATE=177,cinder:DELETE=15,cinder:INSERT=45 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f65ad17-1a04-4077-971b-89652c95f714]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-f4e79556-4eee-4015-b4b0-0ec10b0eed35 req-45899502-5096-4802-8336-53bc5ccdaa65 tempest-AttachVolumeTestJSON-1498965026 None] Terminate volume connection completed successfully. Sep 10 20:11:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-f4e79556-4eee-4015-b4b0-0ec10b0eed35 req-45899502-5096-4802-8336-53bc5ccdaa65 tempest-AttachVolumeTestJSON-1498965026 None] Deleting attachment 71ac9416-853f-4aa5-ae03-6d57af912b6c. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:11:21 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac Sep 10 20:11:21 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:21 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac" returned: 0 in 0.478s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab993f98-77d3-45e6-959a-ee4096d54557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:11:21 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb929878-ba44-46a2-aba3-7ada36ea02d9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:21 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 Sep 10 20:11:21 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:22 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557" returned: 0 in 0.583s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:11:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:11:22 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:11:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:22 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c Sep 10 20:11:22 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:27 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" returned: 0 in 5.667s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:27 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:11:27 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Converted 1024.00 MB image at 180.65 MB/s Sep 10 20:11:27 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c is being set with open permissions: ugo+rw Sep 10 20:11:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:27 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c Sep 10 20:11:27 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:28 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" returned: 0 in 0.281s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" released by "_copy_volume_from_snapshot" :: held 7.162s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-quobyte-a73dcdfa-7c2e-4952-9938-7843a79100ac" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-a73dcdfa-7c2e-4952-9938-7843a79100ac" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Deleting offline snapshot a73dcdfa-7c2e-4952-9938-7843a79100ac of volume ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] snapshot_file for this snap is: volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa85dd4-cda7-422b-a6cf-2ef814904723]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:28 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac Sep 10 20:11:28 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:28 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac" returned: 0 in 0.410s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab993f98-77d3-45e6-959a-ee4096d54557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdd9298-227d-46ae-b7c2-1742c5a0e82d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:28 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 Sep 10 20:11:28 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:29 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557" returned: 0 in 0.655s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:29 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac Sep 10 20:11:29 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:29 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac" returned: 0 in 0.476s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:29 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac Sep 10 20:11:29 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:30 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557.a73dcdfa-7c2e-4952-9938-7843a79100ac" returned: 0 in 0.538s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:30 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-a73dcdfa-7c2e-4952-9938-7843a79100ac" released by "_delete_snapshot" :: held 2.238s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.697s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf095b8-b80e-4d5d-be45-603c7c7d4922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c', 'volume_size': 1, 'source_volid': 'ab993f98-77d3-45e6-959a-ee4096d54557', 'source_volstatus': 'available'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4745bf2-d1fe-464e-b7d5-8d9639ce32cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Volume volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c (8c5854d4-6a47-45ee-a300-59f00e4f8c9c): created successfully Sep 10 20:11:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4745bf2-d1fe-464e-b7d5-8d9639ce32cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (e3ae7b66-7be5-4c36-a61c-a9638fec7a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b282b4bc-de42-42de-a20f-91887559a0bc tempest-VolumesGetTest-171973747 None] Created volume successfully. Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (6a780767-a642-4b35-b258-0bfb8b0486e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5269993d-3b8a-44f6-957c-8a1448c48fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5269993d-3b8a-44f6-957c-8a1448c48fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2103059946',display_name='tempest-VolumesGetTest-Volume-184998831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a873bd-589f-4c62-b87f-a722e4722098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:33Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a99a59f-fcf3-4aee-98df-5426cc223938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a99a59f-fcf3-4aee-98df-5426cc223938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2ed376-8ffa-4aaa-88c9-17f4df3e4093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2ed376-8ffa-4aaa-88c9-17f4df3e4093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a873bd-589f-4c62-b87f-a722e4722098', 'volume_name': 'volume-77a873bd-589f-4c62-b87f-a722e4722098', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37bbd1b-1338-4d4a-9fd4-aa67406cbe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37bbd1b-1338-4d4a-9fd4-aa67406cbe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4693da-47bf-4dd1-a6f0-1841bda5ca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Volume 77a873bd-589f-4c62-b87f-a722e4722098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a873bd-589f-4c62-b87f-a722e4722098', 'volume_size': 1} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2103059946',display_name='tempest-VolumesGetTest-Volume-184998831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a873bd-589f-4c62-b87f-a722e4722098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:33Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Creating volume 77a873bd-589f-4c62-b87f-a722e4722098 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:32 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:32 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098 1073741824 Sep 10 20:11:32 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:33 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098 1073741824" returned: 0 in 0.917s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:33 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098 Sep 10 20:11:33 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:34 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098" returned: 0 in 0.363s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4693da-47bf-4dd1-a6f0-1841bda5ca77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a873bd-589f-4c62-b87f-a722e4722098', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a02e84f-b01a-4aa5-8d7e-a2be40310425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:34 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Volume volume-77a873bd-589f-4c62-b87f-a722e4722098 (77a873bd-589f-4c62-b87f-a722e4722098): created successfully Sep 10 20:11:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a02e84f-b01a-4aa5-8d7e-a2be40310425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (6a780767-a642-4b35-b258-0bfb8b0486e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2f897752-c7f4-4bff-bfbe-efca93c6efb9 tempest-VolumesGetTest-171973747 None] Created volume successfully. Sep 10 20:11:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-77a873bd-589f-4c62-b87f-a722e4722098-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Lock "cinder-77a873bd-589f-4c62-b87f-a722e4722098-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-quobyte-77a873bd-589f-4c62-b87f-a722e4722098" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-77a873bd-589f-4c62-b87f-a722e4722098" acquired by "delete_volume" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6d67f9-95c7-4723-a6b4-d838c79c17c9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:35 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098 Sep 10 20:11:35 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Flow 'volume_create_manager' (52971978-6b42-481d-be80-d15190eb0e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c10a64-f592-4046-84e2-6dc047c359e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c10a64-f592-4046-84e2-6dc047c359e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-338757361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2833be-00ff-4564-a825-957a16aa5b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d119a5b3bcff4ccaab59ace60a76dc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:36Z,use_quota=True,user_id='b777651f03fe45cba6763299321102f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(972ebfc1-b2a1-40cd-b7da-c28192a0f43f),volume_type_id=972ebfc1-b2a1-40cd-b7da-c28192a0f43f)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0712e2-44cf-4a5b-bb2b-42512381c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0712e2-44cf-4a5b-bb2b-42512381c103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6a5f26-dbcb-4aaf-ade8-c40b13ed1249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6a5f26-dbcb-4aaf-ade8-c40b13ed1249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2833be-00ff-4564-a825-957a16aa5b90', 'volume_name': 'volume-0b2833be-00ff-4564-a825-957a16aa5b90', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b872fb-84f6-4d0f-b76a-e3deee6e3a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b872fb-84f6-4d0f-b76a-e3deee6e3a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136240eb-e71d-4761-a3fc-4aac41973c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:35 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Volume 0b2833be-00ff-4564-a825-957a16aa5b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2833be-00ff-4564-a825-957a16aa5b90', 'volume_size': 1} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-338757361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2833be-00ff-4564-a825-957a16aa5b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d119a5b3bcff4ccaab59ace60a76dc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:36Z,use_quota=True,user_id='b777651f03fe45cba6763299321102f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(972ebfc1-b2a1-40cd-b7da-c28192a0f43f),volume_type_id=972ebfc1-b2a1-40cd-b7da-c28192a0f43f)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Creating volume 0b2833be-00ff-4564-a825-957a16aa5b90 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:35 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:35 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098" returned: 0 in 0.751s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:35 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90 1073741824 Sep 10 20:11:35 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:35 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098 Sep 10 20:11:35 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:36 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-77a873bd-589f-4c62-b87f-a722e4722098" returned: 0 in 0.324s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-77a873bd-589f-4c62-b87f-a722e4722098" released by "delete_volume" :: held 1.172s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Created reservations ['33a8fb86-d3e3-4f1a-a03c-563114290d23', '96ec5705-e803-4ee4-899b-ca086ebf5c71', 'ca28598c-8ade-414a-bf5e-c58f3a0530c1', '2ac84cb5-82a1-4de9-a8b1-0f57a6e49afd'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:36 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:36 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:36 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90 1073741824" returned: 0 in 0.618s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:36 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90 Sep 10 20:11:36 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:36 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.332s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Deleted volume successfully. Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-31f6cd1b-0aac-4443-9765-273f02acaa2f tempest-VolumesGetTest-171973747 None] Lock "cinder-77a873bd-589f-4c62-b87f-a722e4722098-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:36 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90" returned: 0 in 0.363s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136240eb-e71d-4761-a3fc-4aac41973c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2833be-00ff-4564-a825-957a16aa5b90', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71353e3-c19e-42c5-b312-f9746cfc3388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:36 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Volume volume-0b2833be-00ff-4564-a825-957a16aa5b90 (0b2833be-00ff-4564-a825-957a16aa5b90): created successfully Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71353e3-c19e-42c5-b312-f9746cfc3388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Flow 'volume_create_manager' (52971978-6b42-481d-be80-d15190eb0e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-028dd6eb-d42b-4200-8cc2-0f94e96201ae tempest-VolumeTypesAccessTest-241409324 None] Created volume successfully. Sep 10 20:11:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-8c5854d4-6a47-45ee-a300-59f00e4f8c9c-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Lock "cinder-8c5854d4-6a47-45ee-a300-59f00e4f8c9c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-quobyte-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:37 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f5d1b9-a63a-421d-9da8-7a41828860cb]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:37 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c Sep 10 20:11:37 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Acquiring lock "cinder-0b2833be-00ff-4564-a825-957a16aa5b90-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Lock "cinder-0b2833be-00ff-4564-a825-957a16aa5b90-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:38 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" returned: 0 in 0.688s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Acquiring lock "cinder-quobyte-0b2833be-00ff-4564-a825-957a16aa5b90" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:38 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c Sep 10 20:11:38 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Lock "cinder-quobyte-0b2833be-00ff-4564-a825-957a16aa5b90" acquired by "delete_volume" :: waited 0.047s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feaf83f-e125-4605-890f-19c1752a0df9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:38 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90 Sep 10 20:11:38 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:38 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" returned: 0 in 0.397s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-8c5854d4-6a47-45ee-a300-59f00e4f8c9c" released by "delete_volume" :: held 1.169s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Created reservations ['dc775a62-6803-4484-b31c-580efdfa1875', '40b009d8-3045-446e-aa20-536b76324427', 'f2f9a653-643b-4902-bbc6-b619ee6ab68f', '91e67aeb-910c-4c67-9726-4b9563930833'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:38 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90" returned: 0 in 0.537s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:38 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:38 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:38 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90 Sep 10 20:11:38 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:39 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.337s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Deleted volume successfully. Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-08411ecd-52ca-427c-bed3-9d89f47081f0 tempest-VolumesGetTest-171973747 None] Lock "cinder-8c5854d4-6a47-45ee-a300-59f00e4f8c9c-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:39 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b2833be-00ff-4564-a825-957a16aa5b90" returned: 0 in 0.391s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Lock "cinder-quobyte-0b2833be-00ff-4564-a825-957a16aa5b90" released by "delete_volume" :: held 1.026s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:39 devstack cinder-volume[88137]: WARNING cinder.quota [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-295442399 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-295442399, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:11:39 devstack cinder-volume[88137]: WARNING cinder.quota [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-295442399 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-295442399, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Created reservations ['99fb400d-85f9-49c3-bffd-20449c83bcba', 'f9a867d0-f3b1-41ca-93e6-41b7a523e82c', 'a5b69a45-e9e9-40b1-84a2-98ffd5553294', 'f71e3d66-a9d3-4a3f-b3c1-2e3afaccd94a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:39 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:39 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:39 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.280s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Deleted volume successfully. Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-ab993f98-77d3-45e6-959a-ee4096d54557-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-35fad20b-5d96-4f86-983b-f091ea888dff tempest-VolumeTypesAccessTest-241409324 None] Lock "cinder-0b2833be-00ff-4564-a825-957a16aa5b90-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Lock "cinder-ab993f98-77d3-45e6-959a-ee4096d54557-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-quobyte-ab993f98-77d3-45e6-959a-ee4096d54557" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-ab993f98-77d3-45e6-959a-ee4096d54557" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[655077ea-6b89-421d-8a2e-500aed6932ae]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:40 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 Sep 10 20:11:40 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:40 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557" returned: 0 in 0.420s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:40 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557 Sep 10 20:11:40 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Flow 'volume_create_manager' (4780ae7a-9afe-4478-a1dd-15b296cdc822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa3141d-931c-4095-850d-ad0b97086eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa3141d-931c-4095-850d-ad0b97086eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-626217959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53244748-88c8-4b80-ad0b-ae974a7eaaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55860857b88e4de1adb411520a2ea59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:40Z,use_quota=True,user_id='b7ad557d92df472995d52f322309643f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca152a01-b68d-46bd-9bd6-917d1be07b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca152a01-b68d-46bd-9bd6-917d1be07b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e70b13e-58dd-424e-b7b5-680e42b94dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e70b13e-58dd-424e-b7b5-680e42b94dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53244748-88c8-4b80-ad0b-ae974a7eaaef', 'volume_name': 'volume-53244748-88c8-4b80-ad0b-ae974a7eaaef', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de871376-574d-455a-8e03-ea9124a38c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de871376-574d-455a-8e03-ea9124a38c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ea2ef9-3d38-42a3-8ad9-2bf47ee9625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:40 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Volume 53244748-88c8-4b80-ad0b-ae974a7eaaef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53244748-88c8-4b80-ad0b-ae974a7eaaef', 'volume_size': 1} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-626217959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53244748-88c8-4b80-ad0b-ae974a7eaaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55860857b88e4de1adb411520a2ea59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:40Z,use_quota=True,user_id='b7ad557d92df472995d52f322309643f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Creating volume 53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:40 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:40 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef 1073741824 Sep 10 20:11:40 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:40 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ab993f98-77d3-45e6-959a-ee4096d54557" returned: 0 in 0.353s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-ab993f98-77d3-45e6-959a-ee4096d54557" released by "delete_volume" :: held 0.843s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Created reservations ['e809c02e-09e1-40bd-9252-d924fbe5e672', '95c1461e-a2db-499e-9619-5e13c0beb72a', 'af4d99db-cc0d-4590-a711-c2fe9475e1f9', '1e8b0e97-3d58-41a4-b34c-43c0e0ac9a45'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:41 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:41 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:41 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef 1073741824" returned: 0 in 0.629s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:41 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef Sep 10 20:11:41 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:41 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.459s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Deleted volume successfully. Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-93d8644c-5ab8-480d-b7e4-7edf2f7c17b7 tempest-VolumesGetTest-171973747 None] Lock "cinder-ab993f98-77d3-45e6-959a-ee4096d54557-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:41 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef" returned: 0 in 0.421s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ea2ef9-3d38-42a3-8ad9-2bf47ee9625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53244748-88c8-4b80-ad0b-ae974a7eaaef', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23b0d75-55ee-4973-907b-a13b9fac4a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:41 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Volume volume-53244748-88c8-4b80-ad0b-ae974a7eaaef (53244748-88c8-4b80-ad0b-ae974a7eaaef): created successfully Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23b0d75-55ee-4973-907b-a13b9fac4a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Flow 'volume_create_manager' (4780ae7a-9afe-4478-a1dd-15b296cdc822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-52fcec5f-c364-48cc-8ccb-7dda8ff5a9ef tempest-VolumesActionsTest-337649626 None] Created volume successfully. Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (ce0b4445-f00c-4289-9596-e9e45596a650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aec522-d958-4fcd-82c7-25dae2e193f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aec522-d958-4fcd-82c7-25dae2e193f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-748705942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87797927-aa42-4f31-b2d9-9d2303986dc2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:42Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db0032a-f123-4051-b8aa-4a609d0085b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db0032a-f123-4051-b8aa-4a609d0085b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cd64ad-bbc1-4900-8713-5474746500a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cd64ad-bbc1-4900-8713-5474746500a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87797927-aa42-4f31-b2d9-9d2303986dc2', 'volume_name': 'volume-87797927-aa42-4f31-b2d9-9d2303986dc2', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71a0d98-989a-4f6b-a8c0-dce4be032416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71a0d98-989a-4f6b-a8c0-dce4be032416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72d69f6-11a1-4979-9646-baf75df9aa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:42 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Volume 87797927-aa42-4f31-b2d9-9d2303986dc2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87797927-aa42-4f31-b2d9-9d2303986dc2', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 20:11:42 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Trying to clone 87797927-aa42-4f31-b2d9-9d2303986dc2 from image c78ee229-c276-4323-b914-d91a23a49bd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:11:43 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:11:43 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Image download 20.69 MB at 20.69 MB/s Sep 10 20:11:43 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1ff19e-d5a0-4d20-81af-c4d79499e2e0]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:43 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD Sep 10 20:11:43 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:43 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD" returned: 0 in 0.466s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:43 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 is fetched for user 3d26e337dd764257aa3a4fda1fa430a1. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a710ff0-59ee-49b3-b1f3-bc8a343a3f3c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:44 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD Sep 10 20:11:44 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:44 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD" returned: 0 in 0.727s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-748705942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87797927-aa42-4f31-b2d9-9d2303986dc2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:42Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Creating volume 87797927-aa42-4f31-b2d9-9d2303986dc2 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:44 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:44 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 1073741824 Sep 10 20:11:44 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:45 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 1073741824" returned: 0 in 0.773s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:45 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 Sep 10 20:11:45 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:46 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2" returned: 0 in 0.442s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:46 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Attempting download of c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume 87797927-aa42-4f31-b2d9-9d2303986dc2. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:11:46 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c7923f-f539-4d48-9aa7-abcfc3137a0f]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_zm8n3lez {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:46 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_zm8n3lez Sep 10 20:11:46 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:46 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_zm8n3lez" returned: 0 in 0.490s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_zm8n3lez {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:46 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_zm8n3lez Sep 10 20:11:46 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:47 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_zm8n3lez" returned: 1 in 0.501s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_zm8n3lez' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:11:47 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e10de-fa54-45d2-9d1f-2d6601f0955d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:47 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD Sep 10 20:11:47 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:47 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:47 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] c78ee229-c276-4323-b914-d91a23a49bd6 was qcow2, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:11:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:47 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 Sep 10 20:11:47 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:50 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2" returned: 0 in 2.605s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_x73n04t9devstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:11:50 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Converted 112.00 MB image at 42.86 MB/s Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:50 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 1G Sep 10 20:11:50 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:50 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 1G" returned: 0 in 0.712s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Downloaded image c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume 87797927-aa42-4f31-b2d9-9d2303986dc2 successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 for user 3d26e337dd764257aa3a4fda1fa430a1 is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Marking volume 87797927-aa42-4f31-b2d9-9d2303986dc2 as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=118,cinder:UPDATE=132,cinder:INSERT=32,cinder:DELETE=9 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Copying metadata from image c78ee229-c276-4323-b914-d91a23a49bd6 to 87797927-aa42-4f31-b2d9-9d2303986dc2. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:11:50 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Creating volume glance metadata for volume 87797927-aa42-4f31-b2d9-9d2303986dc2 backed by image c78ee229-c276-4323-b914-d91a23a49bd6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:11:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72d69f6-11a1-4979-9646-baf75df9aa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87797927-aa42-4f31-b2d9-9d2303986dc2', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e6ec28-3f85-411a-92d1-c791399ed0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Volume volume-87797927-aa42-4f31-b2d9-9d2303986dc2 (87797927-aa42-4f31-b2d9-9d2303986dc2): created successfully Sep 10 20:11:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e6ec28-3f85-411a-92d1-c791399ed0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (ce0b4445-f00c-4289-9596-e9e45596a650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-caba2c23-ad48-4428-b46e-3457d1c76c9f tempest-VolumesGetTest-171973747 None] Created volume successfully. Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d485c815-9739-4a93-94d0-6ba89d769ca4 tempest-VolumesActionsTest-337649626 None] Acquiring lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef" by "attach_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d485c815-9739-4a93-94d0-6ba89d769ca4 tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef" acquired by "attach_volume" :: waited 0.036s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (7492beb4-6fee-4f79-91a6-d1707405c0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be838a45-fa81-4a84-b3af-6c5665cda17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be838a45-fa81-4a84-b3af-6c5665cda17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-998757178',display_name='tempest-VolumesGetTest-Volume-1034406786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cf8e17-c387-48cd-8079-7d57e98e2652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:53Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e890f88c-110d-4bcc-9112-148fce6fa29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e890f88c-110d-4bcc-9112-148fce6fa29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ed0846-d730-4d31-85af-abdc34d20a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ed0846-d730-4d31-85af-abdc34d20a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4cf8e17-c387-48cd-8079-7d57e98e2652', 'volume_name': 'volume-f4cf8e17-c387-48cd-8079-7d57e98e2652', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff65bf7-8d85-42e3-81ed-bf3048f25d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff65bf7-8d85-42e3-81ed-bf3048f25d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6a7dbb-50c6-4b75-af07-3d50997b6bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:53 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Volume f4cf8e17-c387-48cd-8079-7d57e98e2652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4cf8e17-c387-48cd-8079-7d57e98e2652', 'volume_size': 1} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:11:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-998757178',display_name='tempest-VolumesGetTest-Volume-1034406786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cf8e17-c387-48cd-8079-7d57e98e2652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f304bdcb368643909d85bfb0585be969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:11:53Z,use_quota=True,user_id='3d26e337dd764257aa3a4fda1fa430a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Creating volume f4cf8e17-c387-48cd-8079-7d57e98e2652 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:11:53 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d485c815-9739-4a93-94d0-6ba89d769ca4 tempest-VolumesActionsTest-337649626 None] Attaching volume 53244748-88c8-4b80-ad0b-ae974a7eaaef to instance b0e5bc29-891b-4078-9c57-a1a476065ea0 at mountpoint /dev/vdb on host None. Sep 10 20:11:53 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 1073741824 Sep 10 20:11:53 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d485c815-9739-4a93-94d0-6ba89d769ca4 tempest-VolumesActionsTest-337649626 None] Attach volume completed successfully. Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d485c815-9739-4a93-94d0-6ba89d769ca4 tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef" released by "attach_volume" :: held 0.386s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4f4acc3d-bee5-40b0-9992-b06294a0f58a tempest-VolumesActionsTest-337649626 None] Acquiring lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef-detach_volume" by "detach_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4f4acc3d-bee5-40b0-9992-b06294a0f58a tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:54 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4f4acc3d-bee5-40b0-9992-b06294a0f58a tempest-VolumesActionsTest-337649626 None] Detaching volume 53244748-88c8-4b80-ad0b-ae974a7eaaef from instance b0e5bc29-891b-4078-9c57-a1a476065ea0. Sep 10 20:11:54 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4f4acc3d-bee5-40b0-9992-b06294a0f58a tempest-VolumesActionsTest-337649626 None] Detach volume completed successfully. Sep 10 20:11:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4f4acc3d-bee5-40b0-9992-b06294a0f58a tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:54 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 1073741824" returned: 0 in 0.925s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:54 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 Sep 10 20:11:54 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:55 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652" returned: 0 in 0.455s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6a7dbb-50c6-4b75-af07-3d50997b6bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4cf8e17-c387-48cd-8079-7d57e98e2652', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bb4b99-c32a-4f3e-890d-f68bc05d53e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:11:55 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Volume volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 (f4cf8e17-c387-48cd-8079-7d57e98e2652): created successfully Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bb4b99-c32a-4f3e-890d-f68bc05d53e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Flow 'volume_create_manager' (7492beb4-6fee-4f79-91a6-d1707405c0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:11:55 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6dd5b6da-d65d-4afa-82d5-bfb069828ba1 tempest-VolumesGetTest-171973747 None] Created volume successfully. Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-f4cf8e17-c387-48cd-8079-7d57e98e2652-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Lock "cinder-f4cf8e17-c387-48cd-8079-7d57e98e2652-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-quobyte-f4cf8e17-c387-48cd-8079-7d57e98e2652" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-f4cf8e17-c387-48cd-8079-7d57e98e2652" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[468d7c8d-dc29-4aa9-86ba-ae78ac5efd4b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:56 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 Sep 10 20:11:56 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:56 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652" returned: 0 in 0.468s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:56 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652 Sep 10 20:11:56 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:56 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f4cf8e17-c387-48cd-8079-7d57e98e2652" returned: 0 in 0.316s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-f4cf8e17-c387-48cd-8079-7d57e98e2652" released by "delete_volume" :: held 0.850s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Created reservations ['1ed45ed9-960d-4aef-a3ee-c318f01170d9', 'd13c4f65-7cfa-4a29-912d-d6c164a181d5', '45cf6fc5-eb07-4d3a-91d7-36331848c944', '3636b122-67ad-4e5c-9a26-0d772bdb60cf'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:56 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:56 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-87797927-aa42-4f31-b2d9-9d2303986dc2-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Lock "cinder-87797927-aa42-4f31-b2d9-9d2303986dc2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Acquiring lock "cinder-quobyte-87797927-aa42-4f31-b2d9-9d2303986dc2" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-87797927-aa42-4f31-b2d9-9d2303986dc2" acquired by "delete_volume" :: waited 0.038s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[feed2df8-7bd1-4166-a131-e92a14d02d68]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:57 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.436s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Deleted volume successfully. Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c71f2ff-8aa2-4545-9de3-b4d45f209e9f tempest-VolumesGetTest-171973747 None] Lock "cinder-f4cf8e17-c387-48cd-8079-7d57e98e2652-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:57 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 Sep 10 20:11:57 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:57 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2" returned: 0 in 0.505s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:57 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2 Sep 10 20:11:57 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:58 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-87797927-aa42-4f31-b2d9-9d2303986dc2" returned: 0 in 0.354s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Lock "cinder-quobyte-87797927-aa42-4f31-b2d9-9d2303986dc2" released by "delete_volume" :: held 0.943s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Created reservations ['ee2923f1-1fa3-451e-a1df-3686ed7cef6a', 'e49b85e7-45d6-4dc5-8645-2791e32320fe', 'e921cd42-91fc-4699-81c8-c15076e707ee', '913a0822-65fd-4023-aa9d-3b53d3e59db1'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:11:58 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:11:58 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:11:58 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.316s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:11:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Deleted volume successfully. Sep 10 20:11:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b902084f-2059-4067-a964-fca641227195 tempest-VolumesGetTest-171973747 None] Lock "cinder-87797927-aa42-4f31-b2d9-9d2303986dc2-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:12:08 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=82,cinder:SELECT=52,cinder:INSERT=28,cinder:DELETE=6 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:12:08 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:INSERT=10,cinder:SELECT=26,cinder:UPDATE=22,cinder:DELETE=4 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:12:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:12:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:12:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:12:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:12:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:12:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:12:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:20 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:12:20 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8b837183-3705-412a-a00c-da864db56a4d tempest-VolumesActionsTest-337649626 None] Acquiring lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef" by "attach_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:12:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8b837183-3705-412a-a00c-da864db56a4d tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef" acquired by "attach_volume" :: waited 0.077s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:12:20 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8b837183-3705-412a-a00c-da864db56a4d tempest-VolumesActionsTest-337649626 None] Attaching volume 53244748-88c8-4b80-ad0b-ae974a7eaaef to instance 5875c3e6-c713-413b-a9e4-edea9c8f1b56 at mountpoint /dev/vdb on host None. Sep 10 20:12:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8b837183-3705-412a-a00c-da864db56a4d tempest-VolumesActionsTest-337649626 None] Attach volume completed successfully. Sep 10 20:12:21 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.620s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:21 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:12:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8b837183-3705-412a-a00c-da864db56a4d tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef" released by "attach_volume" :: held 0.382s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:12:21 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:12:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 28 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:12:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:12:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c3b04cb9-9ee0-4641-81c4-ab00c342a1aa tempest-VolumesActionsTest-337649626 None] Acquiring lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef-detach_volume" by "detach_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:12:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c3b04cb9-9ee0-4641-81c4-ab00c342a1aa tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:12:22 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c3b04cb9-9ee0-4641-81c4-ab00c342a1aa tempest-VolumesActionsTest-337649626 None] Detaching volume 53244748-88c8-4b80-ad0b-ae974a7eaaef from instance 5875c3e6-c713-413b-a9e4-edea9c8f1b56. Sep 10 20:12:22 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c3b04cb9-9ee0-4641-81c4-ab00c342a1aa tempest-VolumesActionsTest-337649626 None] Detach volume completed successfully. Sep 10 20:12:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c3b04cb9-9ee0-4641-81c4-ab00c342a1aa tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (82fcad03-a7d5-4e8a-9558-bdd4b23ff62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5345fe5e-66fa-4db3-8ca3-32a88ed04e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5345fe5e-66fa-4db3-8ca3-32a88ed04e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1676776499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf25c50-8818-469a-bb8b-1b9a759301bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b4c6659674d4483ed546a9e2fabb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:12:23Z,use_quota=True,user_id='c342c719b5884a1a97bac6416de12c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0fd15d-ed7a-4ee2-a305-ece685faf01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0fd15d-ed7a-4ee2-a305-ece685faf01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e1a343-5c4e-4364-af3c-3220642d78e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e1a343-5c4e-4364-af3c-3220642d78e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf25c50-8818-469a-bb8b-1b9a759301bd', 'volume_name': 'volume-4cf25c50-8818-469a-bb8b-1b9a759301bd', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d2ee14-9907-4555-adb1-f072e5e5f3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d2ee14-9907-4555-adb1-f072e5e5f3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01aa5cd3-01a2-424e-8541-3d063b75cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:23 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Volume 4cf25c50-8818-469a-bb8b-1b9a759301bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf25c50-8818-469a-bb8b-1b9a759301bd', 'volume_size': 1} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1676776499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf25c50-8818-469a-bb8b-1b9a759301bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b4c6659674d4483ed546a9e2fabb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:12:23Z,use_quota=True,user_id='c342c719b5884a1a97bac6416de12c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Creating volume 4cf25c50-8818-469a-bb8b-1b9a759301bd {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:12:23 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:12:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:23 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd 1073741824 Sep 10 20:12:23 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:24 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd 1073741824" returned: 0 in 0.589s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:24 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd Sep 10 20:12:24 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:24 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd" returned: 0 in 0.404s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:12:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:12:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01aa5cd3-01a2-424e-8541-3d063b75cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf25c50-8818-469a-bb8b-1b9a759301bd', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549caf30-e0f0-47cf-9600-81436725f8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:24 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Volume volume-4cf25c50-8818-469a-bb8b-1b9a759301bd (4cf25c50-8818-469a-bb8b-1b9a759301bd): created successfully Sep 10 20:12:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549caf30-e0f0-47cf-9600-81436725f8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (82fcad03-a7d5-4e8a-9558-bdd4b23ff62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:12:24 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2b1003c2-e86f-422f-b3ec-469ee674a506 tempest-VolumesSnapshotTestJSON-1586022467 None] Created volume successfully. Sep 10 20:12:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:12:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:12:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Creating offline snapshot 28210c1d-e017-43b6-b2df-76fe2013712f of volume 4cf25c50-8818-469a-bb8b-1b9a759301bd {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:12:26 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[921b0e9a-cdfd-434e-b9a1-63d024ad7e9d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:12:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:26 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd Sep 10 20:12:26 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:27 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd" returned: 0 in 0.728s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:27 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f 1G Sep 10 20:12:27 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:27 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f 1G" returned: 0 in 0.708s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf25c50-8818-469a-bb8b-1b9a759301bd -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:27 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf25c50-8818-469a-bb8b-1b9a759301bd -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f Sep 10 20:12:27 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:28 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf25c50-8818-469a-bb8b-1b9a759301bd -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f" returned: 0 in 0.402s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:28 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f is being set with open permissions: ugo+rw Sep 10 20:12:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:28 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f Sep 10 20:12:28 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:28 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f" returned: 0 in 0.397s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:28 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.info Sep 10 20:12:28 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:29 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.info" returned: 0 in 0.309s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:29 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.info is being set with open permissions: ugo+rw Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:29 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.info Sep 10 20:12:29 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:29 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.info" returned: 0 in 0.333s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.024s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:12:29 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6b487a72-f4e5-4a23-80d5-166bac05bcb9 tempest-VolumesSnapshotTestJSON-1586022467 None] Create snapshot completed successfully Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab677ae-ff7b-46f1-8727-4951b96fb60a]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:29 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef Sep 10 20:12:29 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-28210c1d-e017-43b6-b2df-76fe2013712f-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-28210c1d-e017-43b6-b2df-76fe2013712f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-4cf25c50-8818-469a-bb8b-1b9a759301bd" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-4cf25c50-8818-469a-bb8b-1b9a759301bd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-28210c1d-e017-43b6-b2df-76fe2013712f" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-28210c1d-e017-43b6-b2df-76fe2013712f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:12:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Deleting offline snapshot 28210c1d-e017-43b6-b2df-76fe2013712f of volume 4cf25c50-8818-469a-bb8b-1b9a759301bd {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] snapshot_file for this snap is: volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6775db-6939-4461-a25f-7402a3b58b59]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:30 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef" returned: 0 in 0.549s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:30 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f Sep 10 20:12:30 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c3a281-720c-4971-b100-e6302136cc5c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:30 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef Sep 10 20:12:30 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:30 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f" returned: 0 in 0.438s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf25c50-8818-469a-bb8b-1b9a759301bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44687ab-b834-4528-9a0c-d46bfc49a22d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:30 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:30 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd Sep 10 20:12:30 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef" returned: 0 in 0.512s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.f3ce9fc5-3f6d-47e9-8a54-cd7286dcda118y34kt_8.img {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:30 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.f3ce9fc5-3f6d-47e9-8a54-cd7286dcda118y34kt_8.img Sep 10 20:12:30 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:31 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd" returned: 0 in 0.513s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:31 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f Sep 10 20:12:31 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:32 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f" returned: 0 in 1.716s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:32 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f Sep 10 20:12:32 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:33 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd.28210c1d-e017-43b6-b2df-76fe2013712f" returned: 0 in 1.033s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-28210c1d-e017-43b6-b2df-76fe2013712f" released by "_delete_snapshot" :: held 4.002s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:12:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-4cf25c50-8818-469a-bb8b-1b9a759301bd" released by "delete_snapshot" :: held 4.059s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:12:34 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Created reservations ['83256025-6423-469a-9fe0-888e4a6ecb2d', 'ea1c416c-8b94-425d-9f5c-09db075b2218', '4fe840cc-ae87-4df5-a2ea-82eb65a9b7c0', '7bd6201d-fdf1-45f4-907f-e6eb92e4b8d8'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:12:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Delete snapshot completed successfully. Sep 10 20:12:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-111d927b-424d-47c2-9e5d-cd6580f241c8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-28210c1d-e017-43b6-b2df-76fe2013712f-delete_snapshot" released by "delete_snapshot" :: held 4.679s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (bee0b3b9-c1c7-404a-9165-497b93d5b746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5297523b-a90a-4b4a-9790-e728628408d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5297523b-a90a-4b4a-9790-e728628408d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1037793165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6621fff5-ea5c-4791-9338-e6e1dd3710f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b4c6659674d4483ed546a9e2fabb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:12:37Z,use_quota=True,user_id='c342c719b5884a1a97bac6416de12c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec5216d-acca-4665-80ef-b28d293ab68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec5216d-acca-4665-80ef-b28d293ab68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575186cc-5ace-42d4-b3bb-a8e691b16b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575186cc-5ace-42d4-b3bb-a8e691b16b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6621fff5-ea5c-4791-9338-e6e1dd3710f4', 'volume_name': 'volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1f8699-f7ee-42fd-803b-c7592b0f7960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1f8699-f7ee-42fd-803b-c7592b0f7960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d452b63-4283-4ddc-90e3-670cb85ddf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:37 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Volume 6621fff5-ea5c-4791-9338-e6e1dd3710f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4', 'volume_size': 1} Sep 10 20:12:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:12:39 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.f3ce9fc5-3f6d-47e9-8a54-cd7286dcda118y34kt_8.img" returned: 0 in 8.792s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2194e1a-dff3-42ef-a278-12253198c5f4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:12:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:12:39 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef Sep 10 20:12:39 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:12:40 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 10 20:12:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef" returned: 0 in 0.926s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:12:40 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef, size 1024.00 MB, duration 8.79 sec, destination /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.f3ce9fc5-3f6d-47e9-8a54-cd7286dcda118y34kt_8.img {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:12:40 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Converted 1024.00 MB image at 116.46 MB/s Sep 10 20:12:40 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] f3ce9fc5-3f6d-47e9-8a54-cd7286dcda11 was raw, no need to convert to raw {{(pid=88137) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 10 20:12:47 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=26,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (8deed6e1-4299-40ea-9d79-1eb693642c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a31d4fb-cb25-402c-a97d-1e9f5d162da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a31d4fb-cb25-402c-a97d-1e9f5d162da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-322828724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e488c794-8152-4536-a1d4-e1d442cc8699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:12:49Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6741d6f5-f842-4d32-aa11-0baac05b6cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6741d6f5-f842-4d32-aa11-0baac05b6cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453560b0-f097-4ea2-aa04-d4cdbf92ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453560b0-f097-4ea2-aa04-d4cdbf92ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e488c794-8152-4536-a1d4-e1d442cc8699', 'volume_name': 'volume-e488c794-8152-4536-a1d4-e1d442cc8699', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138b6c8f-ab1b-4afe-8972-8cc10776124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138b6c8f-ab1b-4afe-8972-8cc10776124d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2afa46-23b8-4893-aa4e-a0ced73a9644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:49 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Volume e488c794-8152-4536-a1d4-e1d442cc8699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e488c794-8152-4536-a1d4-e1d442cc8699', 'volume_size': 1} Sep 10 20:12:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Flow 'volume_create_manager' (95e0e1b4-b8dc-48c4-80f1-bc398da6bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a175f99-2da0-470f-83ee-2831b17fdff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a175f99-2da0-470f-83ee-2831b17fdff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1625709803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac6892f-91c7-4981-9434-1598e85586d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c568403933f9484db8f515abeaee7356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:12:55Z,use_quota=True,user_id='fdd58a62142c45fba3b13a1f1b8e23a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4ad3dc-bd0a-403e-aa2a-52a5a6d5b943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4ad3dc-bd0a-403e-aa2a-52a5a6d5b943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe58845b-e58f-40a8-840e-307bda39e4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe58845b-e58f-40a8-840e-307bda39e4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac6892f-91c7-4981-9434-1598e85586d3', 'volume_name': 'volume-7ac6892f-91c7-4981-9434-1598e85586d3', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0aae42f-c6f0-4910-b4ea-60fcc4403ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0aae42f-c6f0-4910-b4ea-60fcc4403ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7bb539-6897-42f7-9296-a5d274132594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:12:55 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Volume 7ac6892f-91c7-4981-9434-1598e85586d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac6892f-91c7-4981-9434-1598e85586d3', 'volume_size': 1} Sep 10 20:12:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:12:59 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.602s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Uploaded volume to glance image-id: f3ce9fc5-3f6d-47e9-8a54-cd7286dcda11. {{(pid=88137) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.536s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1037793165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6621fff5-ea5c-4791-9338-e6e1dd3710f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b4c6659674d4483ed546a9e2fabb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:12:37Z,use_quota=True,user_id='c342c719b5884a1a97bac6416de12c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Creating volume 6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:04 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:04 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 1073741824 Sep 10 20:13:04 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:04 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c34ba137-b513-4756-85b6-e4cd197604aa tempest-VolumesActionsTest-337649626 None] Copy volume to image completed successfully. Sep 10 20:13:04 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 1073741824" returned: 0 in 0.413s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:04 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 Sep 10 20:13:04 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:04 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4" returned: 0 in 0.247s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.497s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-322828724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e488c794-8152-4536-a1d4-e1d442cc8699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:12:49Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Creating volume e488c794-8152-4536-a1d4-e1d442cc8699 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:04 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d452b63-4283-4ddc-90e3-670cb85ddf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:04 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699 1073741824 Sep 10 20:13:04 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1840ea7-efeb-40bb-bcf4-afdc2ae811e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:04 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Volume volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 (6621fff5-ea5c-4791-9338-e6e1dd3710f4): created successfully Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1840ea7-efeb-40bb-bcf4-afdc2ae811e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (bee0b3b9-c1c7-404a-9165-497b93d5b746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:04 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e2088358-8a99-4cc7-9fb2-08367e984d03 tempest-VolumesSnapshotTestJSON-1586022467 None] Created volume successfully. Sep 10 20:13:05 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699 1073741824" returned: 0 in 0.461s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:05 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699 Sep 10 20:13:05 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:05 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699" returned: 0 in 0.261s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.373s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1625709803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac6892f-91c7-4981-9434-1598e85586d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c568403933f9484db8f515abeaee7356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:12:55Z,use_quota=True,user_id='fdd58a62142c45fba3b13a1f1b8e23a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Creating volume 7ac6892f-91c7-4981-9434-1598e85586d3 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:05 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:05 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3 1073741824 Sep 10 20:13:05 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2afa46-23b8-4893-aa4e-a0ced73a9644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e488c794-8152-4536-a1d4-e1d442cc8699', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f56060f-8a84-49f5-95bb-d716b7342f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:05 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Volume volume-e488c794-8152-4536-a1d4-e1d442cc8699 (e488c794-8152-4536-a1d4-e1d442cc8699): created successfully Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f56060f-8a84-49f5-95bb-d716b7342f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (8deed6e1-4299-40ea-9d79-1eb693642c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:05 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b17a2dee-0e33-4d64-b520-ba7bb416845c tempest-VolumesActionsTest-1735657952 None] Created volume successfully. Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:06 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3 1073741824" returned: 0 in 0.487s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:06 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3 Sep 10 20:13:06 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:06 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3" returned: 0 in 0.276s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.699s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7bb539-6897-42f7-9296-a5d274132594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac6892f-91c7-4981-9434-1598e85586d3', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439c40d2-5d5f-4db3-9903-a01e298d9b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c56460-5266-4c5e-a306-6ec9e241ab1a]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:06 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Volume volume-7ac6892f-91c7-4981-9434-1598e85586d3 (7ac6892f-91c7-4981-9434-1598e85586d3): created successfully Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439c40d2-5d5f-4db3-9903-a01e298d9b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Flow 'volume_create_manager' (95e0e1b4-b8dc-48c4-80f1-bc398da6bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:06 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d1e69ec8-7090-489c-b03f-2315054cf70b tempest-AttachVolumeTestJSON-1498965026 None] Created volume successfully. Sep 10 20:13:06 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef Sep 10 20:13:06 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61091d67-1c23-453f-8cb0-4b065c11acb9 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699" by "attach_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61091d67-1c23-453f-8cb0-4b065c11acb9 tempest-VolumesActionsTest-1735657952 None] Lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699" acquired by "attach_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:06 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-61091d67-1c23-453f-8cb0-4b065c11acb9 tempest-VolumesActionsTest-1735657952 None] Attaching volume e488c794-8152-4536-a1d4-e1d442cc8699 to instance 08aa6a99-dc4d-4614-b91e-e1b48ecfc426 at mountpoint /dev/vdb on host None. Sep 10 20:13:06 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-61091d67-1c23-453f-8cb0-4b065c11acb9 tempest-VolumesActionsTest-1735657952 None] Attach volume completed successfully. Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61091d67-1c23-453f-8cb0-4b065c11acb9 tempest-VolumesActionsTest-1735657952 None] Lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699" released by "attach_volume" :: held 0.087s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:06 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef" returned: 0 in 0.420s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a8773f-1c03-47bc-b667-64d2283644eb]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:07 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef Sep 10 20:13:07 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:07 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef" returned: 0 in 0.552s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:07 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img Sep 10 20:13:07 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f3fa226d-dd9e-4d1b-ace3-ab114f94e026 tempest-VolumesActionsTest-1043397952 None] Terminate volume connection completed successfully. Sep 10 20:13:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f3fa226d-dd9e-4d1b-ace3-ab114f94e026 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699-detach_volume" by "detach_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f3fa226d-dd9e-4d1b-ace3-ab114f94e026 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f3fa226d-dd9e-4d1b-ace3-ab114f94e026 tempest-VolumesActionsTest-1043397952 None] Detaching volume e488c794-8152-4536-a1d4-e1d442cc8699 from instance 08aa6a99-dc4d-4614-b91e-e1b48ecfc426. Sep 10 20:13:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f3fa226d-dd9e-4d1b-ace3-ab114f94e026 tempest-VolumesActionsTest-1043397952 None] Detach volume completed successfully. Sep 10 20:13:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f3fa226d-dd9e-4d1b-ace3-ab114f94e026 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699-detach_volume" released by "detach_volume" :: held 0.131s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-5c8a4c28-ceb6-42c6-b804-f86a52195744 req-bae4e37f-0f5b-4398-bc50-89f968dff2dc tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3ade726b-54e5-46bd-a086-94768dee4376 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699-detach_volume" by "detach_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3ade726b-54e5-46bd-a086-94768dee4376 tempest-VolumesActionsTest-1735657952 None] Lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:08 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3ade726b-54e5-46bd-a086-94768dee4376 tempest-VolumesActionsTest-1735657952 None] Volume detach called, but volume not attached. Sep 10 20:13:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3ade726b-54e5-46bd-a086-94768dee4376 tempest-VolumesActionsTest-1735657952 None] Lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Acquiring lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Acquiring lock "cinder-quobyte-e488c794-8152-4536-a1d4-e1d442cc8699" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Lock "cinder-quobyte-e488c794-8152-4536-a1d4-e1d442cc8699" acquired by "delete_volume" :: waited 0.046s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de33bb9-79ed-4f8b-b44f-fea6e20f8e83]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:09 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699 Sep 10 20:13:09 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:10 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699" returned: 0 in 1.179s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:10 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699 Sep 10 20:13:10 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:11 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e488c794-8152-4536-a1d4-e1d442cc8699" returned: 0 in 0.556s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Lock "cinder-quobyte-e488c794-8152-4536-a1d4-e1d442cc8699" released by "delete_volume" :: held 1.848s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:11 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Created reservations ['544cd472-113f-409b-9fa7-cb709d8e3fa5', '1f28effb-7a66-4d76-9737-4735cd03c231', '73ccd33f-5d44-4349-99a5-21090ab25b06', 'c300918f-8b5b-46f5-b1b8-866300be9199'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:11 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:11 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:12 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.768s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:12 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Deleted volume successfully. Sep 10 20:13:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-57e70f0d-1c14-4f3a-b574-df7bfa1eec6e tempest-VolumesActionsTest-1735657952 None] Lock "cinder-e488c794-8152-4536-a1d4-e1d442cc8699-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:13 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img" returned: 0 in 5.724s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:13 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59e56f2-4f9b-4499-8bbd-637b02efa093]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:13 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef Sep 10 20:13:13 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:13 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef" returned: 0 in 0.665s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:13 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:13:13 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Converted 1024.00 MB image at 178.84 MB/s Sep 10 20:13:13 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] 8dccfb31-2b86-4100-a372-5eebddb88a00 was raw, converting to qcow2 {{(pid=88137) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 10 20:13:13 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8150b9aa-e003-4e44-84b5-1cdc16b53cfc]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:14 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img Sep 10 20:13:14 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:14 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img" returned: 0 in 0.343s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:14 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img Sep 10 20:13:14 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:14 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img" returned: 1 in 0.336s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:13:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img /opt/stack/data/cinder/conversion/vol_upload_nlm89dfr {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:14 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img /opt/stack/data/cinder/conversion/vol_upload_nlm89dfr Sep 10 20:13:14 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:14 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img /opt/stack/data/cinder/conversion/vol_upload_nlm89dfr" returned: 0 in 0.279s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:14 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Image conversion details: src /opt/stack/data/cinder/conversion/53244748-88c8-4b80-ad0b-ae974a7eaaef.temp_image.8dccfb31-2b86-4100-a372-5eebddb88a00e8c0gidw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nlm89dfr {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:13:14 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 10 20:13:14 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[23254b30-f24e-49e8-ae24-88826680f9b4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nlm89dfr {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:15 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nlm89dfr Sep 10 20:13:15 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:15 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nlm89dfr" returned: 0 in 0.321s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (ed746b05-db33-412b-a4ce-78f4cc076cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5684f160-0869-4669-a34f-3f21f840b238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5684f160-0869-4669-a34f-3f21f840b238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1349327813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487c53be-5af1-403c-9c27-c38c562fa2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:16Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3e736c-fc93-4ce7-9666-d39ec1cb720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3e736c-fc93-4ce7-9666-d39ec1cb720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dd37b8-2b12-4a4b-895b-2c86b71dfef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dd37b8-2b12-4a4b-895b-2c86b71dfef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487c53be-5af1-403c-9c27-c38c562fa2a5', 'volume_name': 'volume-487c53be-5af1-403c-9c27-c38c562fa2a5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af6a3eb-62ff-4c94-8d8c-f9ed55ccedf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af6a3eb-62ff-4c94-8d8c-f9ed55ccedf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77161b92-a155-4af1-92d1-3aecab98b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:15 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Volume 487c53be-5af1-403c-9c27-c38c562fa2a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487c53be-5af1-403c-9c27-c38c562fa2a5', 'volume_size': 1} Sep 10 20:13:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.074s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Uploaded volume to glance image-id: 8dccfb31-2b86-4100-a372-5eebddb88a00. {{(pid=88137) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 20:13:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.427s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Creating offline snapshot b9a5f168-d5e4-4652-a00f-9fa03b49ab1b of volume 6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:13:16 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a55f1975-77b5-4c1e-8ba3-f12d13b2fe49 tempest-VolumesActionsTest-337649626 None] Copy volume to image completed successfully. Sep 10 20:13:16 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc32f26b-97a6-42f1-ace8-15e0c844be39]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:16 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 Sep 10 20:13:16 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:16 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4" returned: 0 in 0.349s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:16 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b 1G Sep 10 20:13:16 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:17 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b 1G" returned: 0 in 0.378s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:17 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b Sep 10 20:13:17 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:17 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:17 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b is being set with open permissions: ugo+rw Sep 10 20:13:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:17 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b Sep 10 20:13:17 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:17 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b" returned: 0 in 0.255s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:17 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.info Sep 10 20:13:17 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Acquiring lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Acquiring lock "cinder-quobyte-53244748-88c8-4b80-ad0b-ae974a7eaaef" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Lock "cinder-quobyte-53244748-88c8-4b80-ad0b-ae974a7eaaef" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30b2cfb-3a91-4b32-884c-712038dcfa1b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:18 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.info" returned: 0 in 0.269s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:18 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.info is being set with open permissions: ugo+rw Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:18 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.info Sep 10 20:13:18 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:18 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef Sep 10 20:13:18 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:18 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.info" returned: 0 in 0.241s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-5c8a4c28-ceb6-42c6-b804-f86a52195744 req-bae4e37f-0f5b-4398-bc50-89f968dff2dc tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.439s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-5c8a4c28-ceb6-42c6-b804-f86a52195744 req-bae4e37f-0f5b-4398-bc50-89f968dff2dc tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.581s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1349327813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487c53be-5af1-403c-9c27-c38c562fa2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:16Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Creating volume 487c53be-5af1-403c-9c27-c38c562fa2a5 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:18 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:18 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4652cf53-43b1-4ac2-8114-d415f2daf645 tempest-VolumesSnapshotTestJSON-1586022467 None] Create snapshot completed successfully Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:18 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5 1073741824 Sep 10 20:13:18 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:18 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef Sep 10 20:13:18 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-5c8a4c28-ceb6-42c6-b804-f86a52195744 req-bae4e37f-0f5b-4398-bc50-89f968dff2dc tempest-AttachVolumeTestJSON-1498965026 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-7ac6892f-91c7-4981-9434-1598e85586d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee50d058-95fc-46a4-aff3-492604eb64ad', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:13:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-5c8a4c28-ceb6-42c6-b804-f86a52195744 req-bae4e37f-0f5b-4398-bc50-89f968dff2dc tempest-AttachVolumeTestJSON-1498965026 None] attachment_update completed successfully. Sep 10 20:13:18 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53244748-88c8-4b80-ad0b-ae974a7eaaef" returned: 0 in 0.295s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Lock "cinder-quobyte-53244748-88c8-4b80-ad0b-ae974a7eaaef" released by "delete_volume" :: held 0.723s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:INSERT=11,cinder:SELECT=58,cinder:UPDATE=35,cinder:DELETE=4 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Created reservations ['de5e1fef-5524-4481-9e44-037fcc57db73', 'b859f567-69f7-4c12-b85d-81cc5e840f59', '544876b8-c3cb-4deb-80c0-80f8126079c3', '39018b8b-a6f2-4202-a64a-21295ad043e9'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:18 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5 1073741824" returned: 0 in 0.532s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:19 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:19 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:19 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5 Sep 10 20:13:19 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:19 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5" returned: 0 in 0.343s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77161b92-a155-4af1-92d1-3aecab98b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487c53be-5af1-403c-9c27-c38c562fa2a5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:19 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46737f62-dd6e-4027-bb85-857751c1f178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.456s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Deleted volume successfully. Sep 10 20:13:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Volume volume-487c53be-5af1-403c-9c27-c38c562fa2a5 (487c53be-5af1-403c-9c27-c38c562fa2a5): created successfully Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46737f62-dd6e-4027-bb85-857751c1f178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (ed746b05-db33-412b-a4ce-78f4cc076cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0c92d470-1ed8-42a5-83d8-1f14c18e80f7 tempest-VolumesActionsTest-337649626 None] Lock "cinder-53244748-88c8-4b80-ad0b-ae974a7eaaef-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f8b950c2-8bd1-48dc-9f0c-d62bd4399223 tempest-VolumesActionsTest-1735657952 None] Created volume successfully. Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (5ae1a00e-5144-420e-bd69-259dd5efcfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45c9c50-e0a3-45b6-8b46-ff7c924aad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45c9c50-e0a3-45b6-8b46-ff7c924aad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1474884935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac68866-ae90-4a5b-8d1c-30fbe863d499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b4c6659674d4483ed546a9e2fabb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b9a5f168-d5e4-4652-a00f-9fa03b49ab1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:20Z,use_quota=True,user_id='c342c719b5884a1a97bac6416de12c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74b36e5-aed0-438c-8a43-5d05c17fef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74b36e5-aed0-438c-8a43-5d05c17fef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51004ade-a80a-4f24-9b34-45186bfd449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51004ade-a80a-4f24-9b34-45186bfd449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cac68866-ae90-4a5b-8d1c-30fbe863d499', 'volume_name': 'volume-cac68866-ae90-4a5b-8d1c-30fbe863d499', 'volume_size': 2, 'snapshot_id': 'b9a5f168-d5e4-4652-a00f-9fa03b49ab1b'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1e5a90-7518-466a-b392-2632b8def4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1e5a90-7518-466a-b392-2632b8def4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27afe55-2493-4fd8-839d-3c869883b01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:20 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Volume cac68866-ae90-4a5b-8d1c-30fbe863d499: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cac68866-ae90-4a5b-8d1c-30fbe863d499', 'volume_size': 2, 'snapshot_id': 'b9a5f168-d5e4-4652-a00f-9fa03b49ab1b'} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-b9a5f168-d5e4-4652-a00f-9fa03b49ab1b-cac68866-ae90-4a5b-8d1c-30fbe863d499" by "_create_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-b9a5f168-d5e4-4652-a00f-9fa03b49ab1b-cac68866-ae90-4a5b-8d1c-30fbe863d499" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Creating volume cac68866-ae90-4a5b-8d1c-30fbe863d499 from snapshot b9a5f168-d5e4-4652-a00f-9fa03b49ab1b {{(pid=88137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-cac68866-ae90-4a5b-8d1c-30fbe863d499" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-cac68866-ae90-4a5b-8d1c-30fbe863d499" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] snapshot: b9a5f168-d5e4-4652-a00f-9fa03b49ab1b, volume: cac68866-ae90-4a5b-8d1c-30fbe863d499, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6d71b3-c766-4c66-bd4f-e1e637fe6580]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "cinder-487c53be-5af1-403c-9c27-c38c562fa2a5-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:20 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b Sep 10 20:13:20 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-487c53be-5af1-403c-9c27-c38c562fa2a5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "cinder-quobyte-487c53be-5af1-403c-9c27-c38c562fa2a5" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-quobyte-487c53be-5af1-403c-9c27-c38c562fa2a5" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:20 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:20 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7fd4af-6e03-43ef-bbfd-5925415f8a79]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:20 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5 Sep 10 20:13:20 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:20 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.332s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:13:20 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b" returned: 0 in 0.574s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae34e97-8eae-413a-9c64-4c302d0560ad]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:21 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 Sep 10 20:13:21 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:21 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5" returned: 0 in 0.567s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:21 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5 Sep 10 20:13:21 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Flow 'volume_create_manager' (7eafae01-9fed-46f4-b829-d0170ff63854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f120dca-c279-453a-a7f6-c80e9cb299f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f120dca-c279-453a-a7f6-c80e9cb299f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-686797839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97dcf70-355b-4f71-8f3b-3d7b67a2e53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c568403933f9484db8f515abeaee7356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:21Z,use_quota=True,user_id='fdd58a62142c45fba3b13a1f1b8e23a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630f3f83-0d62-47fe-b49d-8ae7a69154f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630f3f83-0d62-47fe-b49d-8ae7a69154f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfd2815-4e0a-4472-9c6e-20b46078dafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfd2815-4e0a-4472-9c6e-20b46078dafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97dcf70-355b-4f71-8f3b-3d7b67a2e53e', 'volume_name': 'volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f74f913-e694-40b1-b8ae-477d8bd02045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f74f913-e694-40b1-b8ae-477d8bd02045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f417a823-b3d8-4e66-9769-1d4ffbf439ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:21 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Volume c97dcf70-355b-4f71-8f3b-3d7b67a2e53e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e', 'volume_size': 1} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:21 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4" returned: 0 in 0.566s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:21 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-487c53be-5af1-403c-9c27-c38c562fa2a5" returned: 0 in 0.317s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:21 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-quobyte-487c53be-5af1-403c-9c27-c38c562fa2a5" released by "delete_volume" :: held 0.956s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:21 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Created reservations ['9e974a72-eff8-4b2a-82f3-04a3d4a02c22', '4aef30a1-ce79-467a-a834-08fbcb0f8efa', '0d3df2d3-4f95-4b44-b109-816cbce23de9', 'e249e826-4df1-428d-bdc8-fc9c9c5dd462'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:21 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:21 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:21 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.329s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:22 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:22 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Deleted volume successfully. Sep 10 20:13:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4d43bbd9-977a-4366-b553-0bf268bcfae2 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-487c53be-5af1-403c-9c27-c38c562fa2a5-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:23 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (11151cd4-9c95-47ef-b9c5-329976731446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c11c43-6b8e-4782-93d1-e60db65baceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c11c43-6b8e-4782-93d1-e60db65baceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1032468104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:24Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7341dd-c309-4e32-aa48-0a13c4e051c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7341dd-c309-4e32-aa48-0a13c4e051c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6aeb4e-d3cf-4a28-b033-74021cebd1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6aeb4e-d3cf-4a28-b033-74021cebd1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce', 'volume_name': 'volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e124f1-f8b2-427a-9231-f669891ddc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e124f1-f8b2-427a-9231-f669891ddc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f756319-9197-49b9-9e90-5bd6ceb3a844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:24 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Volume 53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce', 'volume_size': 1} Sep 10 20:13:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:26 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499" returned: 0 in 5.419s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:26 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:13:26 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Converted 1024.00 MB image at 188.95 MB/s Sep 10 20:13:26 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 is being set with open permissions: ugo+rw Sep 10 20:13:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:26 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 Sep 10 20:13:26 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:27 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499" returned: 0 in 0.261s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-cac68866-ae90-4a5b-8d1c-30fbe863d499" released by "_copy_volume_from_snapshot" :: held 6.958s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-b9a5f168-d5e4-4652-a00f-9fa03b49ab1b-cac68866-ae90-4a5b-8d1c-30fbe863d499" released by "_create_volume_from_snapshot" :: held 7.029s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.048s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.822s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-686797839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97dcf70-355b-4f71-8f3b-3d7b67a2e53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c568403933f9484db8f515abeaee7356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:21Z,use_quota=True,user_id='fdd58a62142c45fba3b13a1f1b8e23a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Creating volume c97dcf70-355b-4f71-8f3b-3d7b67a2e53e {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:27 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:27 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e 1073741824 Sep 10 20:13:27 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27afe55-2493-4fd8-839d-3c869883b01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac68866-ae90-4a5b-8d1c-30fbe863d499', 'volume_size': 2, 'snapshot_id': 'b9a5f168-d5e4-4652-a00f-9fa03b49ab1b'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682d922e-791f-43d6-8fdf-fdfdad680a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Volume volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 (cac68866-ae90-4a5b-8d1c-30fbe863d499): created successfully Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682d922e-791f-43d6-8fdf-fdfdad680a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (5ae1a00e-5144-420e-bd69-259dd5efcfb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5dd0befc-2b2f-48c9-b3e6-108bf420546a tempest-VolumesSnapshotTestJSON-1586022467 None] Created volume successfully. Sep 10 20:13:27 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e 1073741824" returned: 0 in 0.471s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:27 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e Sep 10 20:13:27 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:27 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e" returned: 0 in 0.258s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.810s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1032468104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:24Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Creating volume 53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:27 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f417a823-b3d8-4e66-9769-1d4ffbf439ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383ef2ae-d210-49b5-a5f2-1324f7431978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:27 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce 1073741824 Sep 10 20:13:27 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-cac68866-ae90-4a5b-8d1c-30fbe863d499-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:28 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Volume volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e (c97dcf70-355b-4f71-8f3b-3d7b67a2e53e): created successfully Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383ef2ae-d210-49b5-a5f2-1324f7431978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Flow 'volume_create_manager' (7eafae01-9fed-46f4-b829-d0170ff63854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-cac68866-ae90-4a5b-8d1c-30fbe863d499-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-bbb20dfb-b1ca-4bab-909f-f81dad41c59c tempest-AttachVolumeTestJSON-1498965026 None] Created volume successfully. Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-cac68866-ae90-4a5b-8d1c-30fbe863d499" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-cac68866-ae90-4a5b-8d1c-30fbe863d499" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66b39c8-2ccd-4362-b334-6a1037d71578]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:28 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 Sep 10 20:13:28 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:28 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce 1073741824" returned: 0 in 0.577s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:28 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499" returned: 0 in 0.436s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:28 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce Sep 10 20:13:28 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:28 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499 Sep 10 20:13:28 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:28 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce" returned: 0 in 0.262s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f756319-9197-49b9-9e90-5bd6ceb3a844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:28 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f5dc18-f160-44db-8bbb-b8add818e2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cac68866-ae90-4a5b-8d1c-30fbe863d499" returned: 0 in 0.277s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-cac68866-ae90-4a5b-8d1c-30fbe863d499" released by "delete_volume" :: held 0.767s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:28 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Volume volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce (53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce): created successfully Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f5dc18-f160-44db-8bbb-b8add818e2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (11151cd4-9c95-47ef-b9c5-329976731446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-acdd83fc-e572-49ab-8869-ec083a7119a0 tempest-VolumesActionsTest-1735657952 None] Created volume successfully. Sep 10 20:13:28 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Created reservations ['5176720b-651f-48b4-ba5b-98086a0353a5', '3140bd55-9c16-4f31-9259-359c20cdb768', 'ec14fbe9-3430-4b52-b5e0-45663f8f7aa5', '1c534efe-0810-4149-b83d-5ab96244dc8a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:29 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:29 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-b9a5f168-d5e4-4652-a00f-9fa03b49ab1b-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-b9a5f168-d5e4-4652-a00f-9fa03b49ab1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-6621fff5-ea5c-4791-9338-e6e1dd3710f4" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-6621fff5-ea5c-4791-9338-e6e1dd3710f4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-b9a5f168-d5e4-4652-a00f-9fa03b49ab1b" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-b9a5f168-d5e4-4652-a00f-9fa03b49ab1b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Deleting offline snapshot b9a5f168-d5e4-4652-a00f-9fa03b49ab1b of volume 6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] snapshot_file for this snap is: volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3e9d10-49a9-4866-a9a1-755be7615cc9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:29 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.423s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:29 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Deleted volume successfully. Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6115f3cd-5c2d-4580-b1bd-06b401e2fd9e tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-cac68866-ae90-4a5b-8d1c-30fbe863d499-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "cinder-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:29 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b Sep 10 20:13:29 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "cinder-quobyte-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-quobyte-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce" acquired by "delete_volume" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[142156f3-f5ee-4f0b-be04-a5fe9fe47ee0]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:29 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce Sep 10 20:13:29 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:29 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b" returned: 0 in 0.475s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[070765e7-b19d-4ccf-b359-d4c4e93181ca]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:30 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 Sep 10 20:13:30 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:30 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce" returned: 0 in 0.503s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:30 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce Sep 10 20:13:30 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-bf1f5f63-8a22-44fc-828e-efcc5be46729 req-dacdded9-fee7-4779-a8d7-8304bb69a428 tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-bf1f5f63-8a22-44fc-828e-efcc5be46729 req-dacdded9-fee7-4779-a8d7-8304bb69a428 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-bf1f5f63-8a22-44fc-828e-efcc5be46729 req-dacdded9-fee7-4779-a8d7-8304bb69a428 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-bf1f5f63-8a22-44fc-828e-efcc5be46729 req-dacdded9-fee7-4779-a8d7-8304bb69a428 tempest-AttachVolumeTestJSON-1498965026 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '536af67c-1ccb-4d1e-abc2-3b1ea1437ebd', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:13:30 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce" returned: 0 in 0.350s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-bf1f5f63-8a22-44fc-828e-efcc5be46729 req-dacdded9-fee7-4779-a8d7-8304bb69a428 tempest-AttachVolumeTestJSON-1498965026 None] attachment_update completed successfully. Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-quobyte-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce" released by "delete_volume" :: held 0.922s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Flow 'volume_create_manager' (5ea97bd1-ef51-4397-a50c-119daf647737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e55ed6-88aa-4751-a2e8-cb497ca8c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:30 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e55ed6-88aa-4751-a2e8-cb497ca8c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1271289602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3489ae32-500c-45ca-ab9e-d6fbeb666eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5493b7b3674ef1936260d4ae13a8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:31Z,use_quota=True,user_id='c7dfa15dc0614068ab0c0e099c936b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f350d01-9c6e-4324-8039-e786f32417ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f350d01-9c6e-4324-8039-e786f32417ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6b9e48-6740-41df-9fc2-bf7ac18f25d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6b9e48-6740-41df-9fc2-bf7ac18f25d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3489ae32-500c-45ca-ab9e-d6fbeb666eb0', 'volume_name': 'volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2e2fea-d3b3-43e2-899c-5dacdff42d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2e2fea-d3b3-43e2-899c-5dacdff42d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b635d9-9f37-431f-b2ec-5d3f880acb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Volume 3489ae32-500c-45ca-ab9e-d6fbeb666eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0', 'volume_size': 1} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1271289602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3489ae32-500c-45ca-ab9e-d6fbeb666eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5493b7b3674ef1936260d4ae13a8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:31Z,use_quota=True,user_id='c7dfa15dc0614068ab0c0e099c936b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Creating volume 3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:30 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4" returned: 0 in 0.789s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:30 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 1073741824 Sep 10 20:13:30 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:30 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b Sep 10 20:13:30 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Created reservations ['78fc594e-ca95-476e-9615-95a59437b434', '993dcc36-58e1-4cd6-bd81-67c2c80e5442', '71aa9a8d-d734-419e-b475-9de7f51d217b', 'd78baec8-0c6a-4ceb-aa34-2c2b0e634965'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:30 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:30 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:31 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.357s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Deleted volume successfully. Sep 10 20:13:31 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-59c569cb-de74-43fd-b3c7-e37c781826e5 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-53ffdcd9-cdf7-44c7-b3c4-6ac7829739ce-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 1073741824" returned: 0 in 0.581s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:31 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b" returned: 0 in 0.571s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:31 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b Sep 10 20:13:31 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:31 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 Sep 10 20:13:31 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:31 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4.b9a5f168-d5e4-4652-a00f-9fa03b49ab1b" returned: 0 in 0.269s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:31 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0" returned: 0 in 0.257s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-b9a5f168-d5e4-4652-a00f-9fa03b49ab1b" released by "_delete_snapshot" :: held 2.253s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b635d9-9f37-431f-b2ec-5d3f880acb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99cab4f2-bd04-48e0-85f6-324dc0567940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-6621fff5-ea5c-4791-9338-e6e1dd3710f4" released by "delete_snapshot" :: held 2.302s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Volume volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 (3489ae32-500c-45ca-ab9e-d6fbeb666eb0): created successfully Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99cab4f2-bd04-48e0-85f6-324dc0567940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Flow 'volume_create_manager' (5ea97bd1-ef51-4397-a50c-119daf647737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-29649c2a-b46b-4b41-8723-f121f20844e3 tempest-VolumesCloneTest-179254979 None] Created volume successfully. Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Created reservations ['232515ca-2b71-4553-92f7-5cb29195d51c', 'd32f7ae0-2b3b-4446-8566-630e69e5c228', '2e8349d7-7559-4ba1-92f1-cd6bb3693cb8', '740d7064-75cb-48e0-92d6-701e92521343'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Delete snapshot completed successfully. Sep 10 20:13:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c37feb2-5ae9-4a57-8009-cc7a699bb8f6 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-b9a5f168-d5e4-4652-a00f-9fa03b49ab1b-delete_snapshot" released by "delete_snapshot" :: held 2.471s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (83597ee7-29d7-42a1-9c8c-7f51e11b98c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f401e81b-392a-4a14-9fca-7165a545440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f401e81b-392a-4a14-9fca-7165a545440e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1392577180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6edada0-d3e6-483a-8c32-85bab2625cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:32Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351df2c5-1067-43d4-ad83-fb2b0fbd9e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351df2c5-1067-43d4-ad83-fb2b0fbd9e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf813bde-c902-4c9d-8c9f-7e0182891d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf813bde-c902-4c9d-8c9f-7e0182891d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6edada0-d3e6-483a-8c32-85bab2625cf7', 'volume_name': 'volume-e6edada0-d3e6-483a-8c32-85bab2625cf7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491d6969-596b-44a1-83ef-c748b6588c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491d6969-596b-44a1-83ef-c748b6588c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733717ac-65ec-4333-9bde-a7763e732a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Volume e6edada0-d3e6-483a-8c32-85bab2625cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6edada0-d3e6-483a-8c32-85bab2625cf7', 'volume_size': 1} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1392577180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6edada0-d3e6-483a-8c32-85bab2625cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:32Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Creating volume e6edada0-d3e6-483a-8c32-85bab2625cf7 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:32 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:32 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 1073741824 Sep 10 20:13:32 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-6621fff5-ea5c-4791-9338-e6e1dd3710f4-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-6621fff5-ea5c-4791-9338-e6e1dd3710f4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-6621fff5-ea5c-4791-9338-e6e1dd3710f4" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-6621fff5-ea5c-4791-9338-e6e1dd3710f4" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[206d674d-04b9-43d2-b293-e608d22b8917]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:32 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 Sep 10 20:13:32 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:32 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 1073741824" returned: 0 in 0.601s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:33 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 Sep 10 20:13:33 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:33 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4" returned: 0 in 0.512s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:33 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4 Sep 10 20:13:33 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-2be6ef26-24a1-4a17-acfe-0f614e7d69cd req-6450b041-1db6-4bc4-8903-2aabebdbb14d tempest-AttachVolumeTestJSON-1498965026 None] Terminate volume connection completed successfully. Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-2be6ef26-24a1-4a17-acfe-0f614e7d69cd req-6450b041-1db6-4bc4-8903-2aabebdbb14d tempest-AttachVolumeTestJSON-1498965026 None] Deleting attachment ee50d058-95fc-46a4-aff3-492604eb64ad. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:33 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7" returned: 0 in 0.356s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733717ac-65ec-4333-9bde-a7763e732a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6edada0-d3e6-483a-8c32-85bab2625cf7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54190eb4-bf80-4187-9772-d9ddb6235f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Flow 'volume_create_manager' (ba582dfe-2d57-474a-8974-4a5b1ef9a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e3670a-ef5e-43eb-b609-39ebda8e1290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e3670a-ef5e-43eb-b609-39ebda8e1290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1463393758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b6f5a7-326e-4e2e-bf08-cb764798fb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5493b7b3674ef1936260d4ae13a8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3489ae32-500c-45ca-ab9e-d6fbeb666eb0,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:33Z,use_quota=True,user_id='c7dfa15dc0614068ab0c0e099c936b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1909b9a1-e402-4fa6-945f-c60cafe370f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1909b9a1-e402-4fa6-945f-c60cafe370f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6224dbe0-f911-4591-80a7-af472e320521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Volume volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 (e6edada0-d3e6-483a-8c32-85bab2625cf7): created successfully Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54190eb4-bf80-4187-9772-d9ddb6235f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (83597ee7-29d7-42a1-9c8c-7f51e11b98c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6224dbe0-f911-4591-80a7-af472e320521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e7b6f5a7-326e-4e2e-bf08-cb764798fb0d', 'volume_name': 'volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d', 'volume_size': 2, 'source_volid': '3489ae32-500c-45ca-ab9e-d6fbeb666eb0', 'source_volstatus': 'available'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d784b1b-07dd-40b5-810d-9a9aa84f5c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d784b1b-07dd-40b5-810d-9a9aa84f5c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3dbbe70-fa5d-4dec-853e-1ef7cd0b2467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Volume e7b6f5a7-326e-4e2e-bf08-cb764798fb0d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d', 'volume_size': 2, 'source_volid': '3489ae32-500c-45ca-ab9e-d6fbeb666eb0', 'source_volstatus': 'available'} Sep 10 20:13:33 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-496d4415-1281-453b-aa11-0a85ae2d7a50 tempest-VolumesActionsTest-1735657952 None] Created volume successfully. Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:33 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Cloning volume 3489ae32-500c-45ca-ab9e-d6fbeb666eb0 to volume e7b6f5a7-326e-4e2e-bf08-cb764798fb0d Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6621fff5-ea5c-4791-9338-e6e1dd3710f4" returned: 0 in 0.351s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-6621fff5-ea5c-4791-9338-e6e1dd3710f4" released by "delete_volume" :: held 0.934s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Creating offline snapshot 906cd0d1-34d8-4813-bc96-563640a1186c of volume 3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f9f251-cf0c-4358-87e5-edd0d7909842]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Created reservations ['7e507da6-aa9b-4ae9-8cdd-dd77447e9aab', 'd4d892f1-9e23-4cca-a692-eec7fa91f6e3', 'c52813f5-cefe-4add-8cf5-185474d7a99a', 'afd15f23-11ee-4a50-8992-fcb015128ba8'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:33 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 Sep 10 20:13:33 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:33 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:33 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:34 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.258s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Deleted volume successfully. Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ca6d5080-2a2c-47da-b90c-1d5f1a2829f8 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-6621fff5-ea5c-4791-9338-e6e1dd3710f4-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:34 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0" returned: 0 in 0.440s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:34 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c 1G Sep 10 20:13:34 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "cinder-e6edada0-d3e6-483a-8c32-85bab2625cf7-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-e6edada0-d3e6-483a-8c32-85bab2625cf7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:34 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c 1G" returned: 0 in 0.500s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:34 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c Sep 10 20:13:34 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "cinder-quobyte-e6edada0-d3e6-483a-8c32-85bab2625cf7" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-quobyte-e6edada0-d3e6-483a-8c32-85bab2625cf7" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-583760e2-c3d9-4f78-b3de-4c7bdec6af4c req-495c8eaa-6bd9-449d-89d9-3aff208180cc tempest-AttachVolumeTestJSON-1498965026 None] Terminate volume connection completed successfully. Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-583760e2-c3d9-4f78-b3de-4c7bdec6af4c req-495c8eaa-6bd9-449d-89d9-3aff208180cc tempest-AttachVolumeTestJSON-1498965026 None] Deleting attachment 536af67c-1ccb-4d1e-abc2-3b1ea1437ebd. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7854622c-7fd4-4e4d-a748-d2799ce86d05]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:34 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 Sep 10 20:13:34 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:35 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c" returned: 0 in 0.390s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:35 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c is being set with open permissions: ugo+rw Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:35 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c Sep 10 20:13:35 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:35 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7" returned: 0 in 0.504s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:35 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7 Sep 10 20:13:35 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:35 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c" returned: 0 in 0.336s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:35 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.info Sep 10 20:13:35 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:35 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (c8d060d7-4800-4958-a464-d10cca44c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7410b10-896f-44c0-a30b-24395e35ccea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e6edada0-d3e6-483a-8c32-85bab2625cf7" returned: 0 in 0.374s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:35 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7410b10-896f-44c0-a30b-24395e35ccea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-800723107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f8167d-d672-448e-ab89-d2d6b2f9aea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b4c6659674d4483ed546a9e2fabb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:36Z,use_quota=True,user_id='c342c719b5884a1a97bac6416de12c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d32bf8-97a7-4472-a429-410706fb8b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d32bf8-97a7-4472-a429-410706fb8b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aa5d01-c6d6-4de6-8fe9-6f94cc57d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aa5d01-c6d6-4de6-8fe9-6f94cc57d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f8167d-d672-448e-ab89-d2d6b2f9aea1', 'volume_name': 'volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0520dfbc-2037-4d2a-b49d-485795a89734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0520dfbc-2037-4d2a-b49d-485795a89734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f31463d-da7b-4427-be1c-3d21f3f76d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:35 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Volume e1f8167d-d672-448e-ab89-d2d6b2f9aea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1', 'volume_size': 1} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-quobyte-e6edada0-d3e6-483a-8c32-85bab2625cf7" released by "delete_volume" :: held 0.996s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.info" returned: 0 in 0.351s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:35 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.info is being set with open permissions: ugo+rw Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:35 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.info Sep 10 20:13:35 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Created reservations ['588f6eb4-e533-48eb-a73e-9534ad33b593', 'd2dc17a1-8a4b-481c-922b-3995ab64e286', 'cf5aceff-9935-4e6e-b4e7-8d5b748c326d', 'cf92a44e-5faa-4e98-a6e8-c4936c9e4179'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:35 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:35 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:36 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.info" returned: 0 in 0.264s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Acquiring lock "cinder-quobyte-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Lock "cinder-quobyte-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] snapshot: 906cd0d1-34d8-4813-bc96-563640a1186c, volume: e7b6f5a7-326e-4e2e-bf08-cb764798fb0d, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0f5fc9-6c92-4b98-a81e-fe3b5bfa1e8f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:36 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.324s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Deleted volume successfully. Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55d314b2-f7c4-4a8d-a8b7-312edaba1b66 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-e6edada0-d3e6-483a-8c32-85bab2625cf7-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:36 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c Sep 10 20:13:36 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:36 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c" returned: 0 in 0.574s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3c96d5-06be-4154-bf97-ac1ce8207b0f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:36 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 Sep 10 20:13:36 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:37 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0" returned: 0 in 0.426s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:37 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d Sep 10 20:13:37 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (2696edd8-1023-4017-9cc5-7930e6c68148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff79706-7a85-4c51-b9b1-62b5e8ea028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff79706-7a85-4c51-b9b1-62b5e8ea028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-674314968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e813096-4c17-44f6-a385-3488296f0c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:37Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a4bc0f-a5a6-4f5a-ab06-c1566af3a6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a4bc0f-a5a6-4f5a-ab06-c1566af3a6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a21d180-1b05-423a-aa5b-15b364394955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a21d180-1b05-423a-aa5b-15b364394955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e813096-4c17-44f6-a385-3488296f0c0c', 'volume_name': 'volume-5e813096-4c17-44f6-a385-3488296f0c0c', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8069f64f-55eb-4f52-b61e-4ed323039e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8069f64f-55eb-4f52-b61e-4ed323039e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390aaa06-0487-4576-829b-49b104107eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:37 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Volume 5e813096-4c17-44f6-a385-3488296f0c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e813096-4c17-44f6-a385-3488296f0c0c', 'volume_size': 1} Sep 10 20:13:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:42 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" returned: 0 in 5.064s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:13:42 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Converted 1024.00 MB image at 202.18 MB/s Sep 10 20:13:42 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d is being set with open permissions: ugo+rw Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:42 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d Sep 10 20:13:42 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "cinder-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "cinder-quobyte-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-quobyte-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5b6c62-d656-42e5-b50d-e8b0396c5564]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:42 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e Sep 10 20:13:42 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:42 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" returned: 0 in 0.256s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Lock "cinder-quobyte-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" released by "_copy_volume_from_snapshot" :: held 6.437s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Acquiring lock "cinder-quobyte-906cd0d1-34d8-4813-bc96-563640a1186c" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Lock "cinder-quobyte-906cd0d1-34d8-4813-bc96-563640a1186c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Deleting offline snapshot 906cd0d1-34d8-4813-bc96-563640a1186c of volume 3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] snapshot_file for this snap is: volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1c3ddb-d7dd-44a5-82f1-238368f05c52]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:42 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c Sep 10 20:13:42 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:42 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e" returned: 0 in 0.361s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:42 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e Sep 10 20:13:42 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:42 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[97602970-60ba-4301-89e0-ddc9fd37e093]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:42 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e" returned: 0 in 0.243s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-quobyte-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e" released by "delete_volume" :: held 0.637s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Created reservations ['2d8753ea-e5d3-40f9-bd54-dfb48cd2082c', 'fe755142-3536-4096-8d9b-dbc8cda7ee0f', '1c3fb9cd-d75e-4a9d-83e4-c272c0e5c7e7', '5fbb593c-0613-4d68-9887-6efc02f7d9c5'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:43 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 Sep 10 20:13:43 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:43 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:43 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:43 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.269s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "cinder-7ac6892f-91c7-4981-9434-1598e85586d3-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:43 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Deleted volume successfully. Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-7ac6892f-91c7-4981-9434-1598e85586d3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-85c0a440-2b91-4f7e-898f-00c476bf077a tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-c97dcf70-355b-4f71-8f3b-3d7b67a2e53e-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "cinder-quobyte-7ac6892f-91c7-4981-9434-1598e85586d3" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:43 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-quobyte-7ac6892f-91c7-4981-9434-1598e85586d3" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0" returned: 0 in 0.600s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[383d39d6-d8ec-45e0-b3b6-0763126837a0]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:43 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c Sep 10 20:13:43 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:43 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3 Sep 10 20:13:43 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:43 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c" returned: 0 in 0.328s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:43 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c Sep 10 20:13:43 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:43 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3" returned: 0 in 0.367s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:43 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3 Sep 10 20:13:43 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:44 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0.906cd0d1-34d8-4813-bc96-563640a1186c" returned: 0 in 0.249s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Lock "cinder-quobyte-906cd0d1-34d8-4813-bc96-563640a1186c" released by "_delete_snapshot" :: held 1.645s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:44 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.595s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.478s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-800723107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f8167d-d672-448e-ab89-d2d6b2f9aea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b4c6659674d4483ed546a9e2fabb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:36Z,use_quota=True,user_id='c342c719b5884a1a97bac6416de12c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Creating volume e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:44 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7ac6892f-91c7-4981-9434-1598e85586d3" returned: 0 in 0.277s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:44 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 1073741824 Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3dbbe70-fa5d-4dec-853e-1ef7cd0b2467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d', 'volume_size': 2, 'source_volid': '3489ae32-500c-45ca-ab9e-d6fbeb666eb0', 'source_volstatus': 'available'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:44 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08643f67-fd9d-4827-ba9b-fc73388e46e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-quobyte-7ac6892f-91c7-4981-9434-1598e85586d3" released by "delete_volume" :: held 0.700s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:44 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Volume volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d (e7b6f5a7-326e-4e2e-bf08-cb764798fb0d): created successfully Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08643f67-fd9d-4827-ba9b-fc73388e46e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Flow 'volume_create_manager' (ba582dfe-2d57-474a-8974-4a5b1ef9a29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a60c518f-e9ed-4502-a18e-8817a773d931 tempest-VolumesCloneTest-179254979 None] Created volume successfully. Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Created reservations ['08fbc6c4-6958-4375-a9c7-0b075a55a435', '42f67f82-9181-49be-9248-20780433f060', '0094bb1f-916f-4888-8745-30099ed6a3f6', '2bc34e48-327f-48a0-912a-948c07d8f2d7'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:44 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:44 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Acquiring lock "cinder-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:44 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Lock "cinder-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.300s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Deleted volume successfully. Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-abcb2299-7c0d-4ab5-a4e1-f62c46139fc0 tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-7ac6892f-91c7-4981-9434-1598e85586d3-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Acquiring lock "cinder-quobyte-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "cinder-8a9aa24c-973d-4be0-87f5-3dd88ce766dd-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Lock "cinder-quobyte-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:44 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-8a9aa24c-973d-4be0-87f5-3dd88ce766dd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 1073741824" returned: 0 in 0.597s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9522786c-b086-45ce-8ddb-543172814eca]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "cinder-quobyte-8a9aa24c-973d-4be0-87f5-3dd88ce766dd" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:44 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 Sep 10 20:13:44 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-quobyte-8a9aa24c-973d-4be0-87f5-3dd88ce766dd" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b60002-9930-482d-b178-3535bdce13e2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:44 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d Sep 10 20:13:44 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:45 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd Sep 10 20:13:45 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:45 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" returned: 0 in 0.269s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.602s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-674314968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e813096-4c17-44f6-a385-3488296f0c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:37Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Creating volume 5e813096-4c17-44f6-a385-3488296f0c0c {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:45 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f31463d-da7b-4427-be1c-3d21f3f76d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:45 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c 1073741824 Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1116a1cb-8869-4b5f-bb06-8de2456519ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:45 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:45 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Volume volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 (e1f8167d-d672-448e-ab89-d2d6b2f9aea1): created successfully Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1116a1cb-8869-4b5f-bb06-8de2456519ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (c8d060d7-4800-4958-a464-d10cca44c614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:45 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a89b21aa-0a34-46d8-949a-95f92f1d7b28 tempest-VolumesSnapshotTestJSON-1586022467 None] Created volume successfully. Sep 10 20:13:45 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" returned: 0 in 0.423s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:45 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d Sep 10 20:13:45 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:45 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd" returned: 0 in 0.429s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:45 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd Sep 10 20:13:45 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:45 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" returned: 0 in 0.273s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Lock "cinder-quobyte-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d" released by "delete_volume" :: held 0.749s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Created reservations ['ff8aaf0b-62a0-40c3-ba58-6ac853ea4951', '162c7328-5eb2-439c-a444-7db8d9727084', 'd8c596bf-2dce-47e1-b9ca-2f50012178bf', '9f20bf88-1a38-497c-a17b-528d82b69fea'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:45 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8a9aa24c-973d-4be0-87f5-3dd88ce766dd" returned: 0 in 0.295s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-quobyte-8a9aa24c-973d-4be0-87f5-3dd88ce766dd" released by "delete_volume" :: held 0.780s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:45 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c 1073741824" returned: 0 in 0.626s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:45 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:45 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Created reservations ['f3c6be1d-6a02-4ea0-b625-474018992fa1', '4aaae55d-02aa-4468-b62f-b31bc0e23fb7', '9caea7e7-16f5-4d0a-99a7-f9506db5d108', 'af3eba23-f28e-422b-be28-0cf7501704fb'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Acquiring lock "cinder-3489ae32-500c-45ca-ab9e-d6fbeb666eb0-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:45 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Lock "cinder-3489ae32-500c-45ca-ab9e-d6fbeb666eb0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:46 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Acquiring lock "cinder-quobyte-3489ae32-500c-45ca-ab9e-d6fbeb666eb0" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Lock "cinder-quobyte-3489ae32-500c-45ca-ab9e-d6fbeb666eb0" acquired by "delete_volume" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:46 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:46 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[173da958-a78d-4b5d-a39e-cbb9b55c0bc0]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:46 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.377s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Deleted volume successfully. Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b4232634-f078-4cc1-8a85-c57cb0237913 tempest-VolumesCloneTest-179254979 None] Lock "cinder-e7b6f5a7-326e-4e2e-bf08-cb764798fb0d-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:46 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c" returned: 0 in 0.324s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:46 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:46 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.360s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390aaa06-0487-4576-829b-49b104107eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e813096-4c17-44f6-a385-3488296f0c0c', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cceeb6-13f2-4857-83eb-0a2c157d9064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Creating offline snapshot 83f132a1-33f8-41a3-93f0-94c77d6501e4 of volume e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:13:46 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Volume volume-5e813096-4c17-44f6-a385-3488296f0c0c (5e813096-4c17-44f6-a385-3488296f0c0c): created successfully Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cceeb6-13f2-4857-83eb-0a2c157d9064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (2696edd8-1023-4017-9cc5-7930e6c68148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[560fe1db-5004-480d-9ca4-2bc4c017524b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:46 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.291s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9b971d99-4b13-42bc-a0de-87cbab03a39f tempest-VolumesActionsTest-1735657952 None] Created volume successfully. Sep 10 20:13:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Deleted volume successfully. Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-923b94b1-fed5-4083-8754-b9f2f9dbb91d tempest-AttachVolumeTestJSON-1498965026 None] Lock "cinder-8a9aa24c-973d-4be0-87f5-3dd88ce766dd-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:46 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 Sep 10 20:13:46 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:46 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0" returned: 0 in 0.402s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:46 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0 Sep 10 20:13:46 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:46 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" returned: 0 in 0.420s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:46 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 1G Sep 10 20:13:46 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:46 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3489ae32-500c-45ca-ab9e-d6fbeb666eb0" returned: 0 in 0.257s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Lock "cinder-quobyte-3489ae32-500c-45ca-ab9e-d6fbeb666eb0" released by "delete_volume" :: held 0.741s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Created reservations ['91526b13-02ae-4503-854b-07f337184567', '1b8c59d7-bd3f-4598-9530-7a6052f261f6', '10e775c3-f5b2-4f68-b281-779d8574928c', '3927247a-5900-404b-b390-fcdc9507bf16'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:46 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:46 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:47 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.330s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:47 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Deleted volume successfully. Sep 10 20:13:47 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 1G" returned: 0 in 0.557s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d4cb8fba-227b-41e6-b98a-bb791f46ffbc tempest-VolumesCloneTest-179254979 None] Lock "cinder-3489ae32-500c-45ca-ab9e-d6fbeb666eb0-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:47 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 Sep 10 20:13:47 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "cinder-5e813096-4c17-44f6-a385-3488296f0c0c-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-5e813096-4c17-44f6-a385-3488296f0c0c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "cinder-quobyte-5e813096-4c17-44f6-a385-3488296f0c0c" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-quobyte-5e813096-4c17-44f6-a385-3488296f0c0c" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[97333568-25c8-4d13-b2d2-2a87a1506739]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:47 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4" returned: 0 in 0.433s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:47 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 is being set with open permissions: ugo+rw Sep 10 20:13:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:47 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 Sep 10 20:13:47 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:47 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c Sep 10 20:13:47 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:48 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4" returned: 0 in 0.383s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:48 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c" returned: 0 in 0.458s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:48 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c Sep 10 20:13:48 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:48 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.info Sep 10 20:13:48 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:48 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5e813096-4c17-44f6-a385-3488296f0c0c" returned: 0 in 0.401s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-quobyte-5e813096-4c17-44f6-a385-3488296f0c0c" released by "delete_volume" :: held 0.924s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:48 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.info" returned: 0 in 0.396s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:48 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.info is being set with open permissions: ugo+rw Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:48 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.info Sep 10 20:13:48 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Created reservations ['59079436-75f9-4e46-a6ae-d366a755fd25', '2a4cf99d-aa71-40c5-bf4d-7d3179e9b8c4', '1a1f74df-983b-4956-9f56-c69bb19a3ffa', 'b92b24c3-0ea4-40ef-805c-16f323fd519e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:48 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:48 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:48 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.info" returned: 0 in 0.336s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-12810ac1-e0be-40e7-985c-5ec614047180 tempest-VolumesSnapshotTestJSON-1586022467 None] Create snapshot completed successfully Sep 10 20:13:49 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.340s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:49 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Deleted volume successfully. Sep 10 20:13:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94342766-0125-43f8-8449-2730aa4b6a58 tempest-VolumesActionsTest-1043397952 None] Lock "cinder-5e813096-4c17-44f6-a385-3488296f0c0c-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (35652da8-8258-43ee-ba77-ffb33db7f46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb2bd85-5055-48ab-b887-ca46dc82c439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb2bd85-5055-48ab-b887-ca46dc82c439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1930075363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b972b4-122e-47c6-ba22-a17b6506fcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:51Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd8a3a0-e2a0-444f-a0d5-18cadad66413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd8a3a0-e2a0-444f-a0d5-18cadad66413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16c7d9-2130-4fa5-8df3-e99127812671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a16c7d9-2130-4fa5-8df3-e99127812671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b972b4-122e-47c6-ba22-a17b6506fcb2', 'volume_name': 'volume-04b972b4-122e-47c6-ba22-a17b6506fcb2', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241fc78d-a899-4d78-9916-fca42e303467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241fc78d-a899-4d78-9916-fca42e303467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48251b27-1e14-4ef8-9120-d599e3b00138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Volume 04b972b4-122e-47c6-ba22-a17b6506fcb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b972b4-122e-47c6-ba22-a17b6506fcb2', 'volume_size': 1} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1930075363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b972b4-122e-47c6-ba22-a17b6506fcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97b3831d923e480094ca0276099f7432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:51Z,use_quota=True,user_id='933192c5cd5e4aa7b7ed62085e95361b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Creating volume 04b972b4-122e-47c6-ba22-a17b6506fcb2 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:51 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:51 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 1073741824 Sep 10 20:13:51 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (4d5a1433-b1ec-4073-8d2c-cd25a74e6094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e3f40d-2bf1-4bb6-b23f-dc58027d80a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e3f40d-2bf1-4bb6-b23f-dc58027d80a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1657525909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4c2733-2ced-44e8-882b-8810d45b78a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b4c6659674d4483ed546a9e2fabb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=83f132a1-33f8-41a3-93f0-94c77d6501e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:51Z,use_quota=True,user_id='c342c719b5884a1a97bac6416de12c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1133b56a-0404-4780-9a3d-d9eec5172ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1133b56a-0404-4780-9a3d-d9eec5172ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393ea39f-8cf7-4615-b2a0-4b5d5f7f9dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393ea39f-8cf7-4615-b2a0-4b5d5f7f9dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc4c2733-2ced-44e8-882b-8810d45b78a6', 'volume_name': 'volume-dc4c2733-2ced-44e8-882b-8810d45b78a6', 'volume_size': 1, 'snapshot_id': '83f132a1-33f8-41a3-93f0-94c77d6501e4'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158dc4a5-f811-4712-834e-6aaea1eb352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158dc4a5-f811-4712-834e-6aaea1eb352e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b811923-7e27-46cb-a4ef-1e5ef2498cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Volume dc4c2733-2ced-44e8-882b-8810d45b78a6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc4c2733-2ced-44e8-882b-8810d45b78a6', 'volume_size': 1, 'snapshot_id': '83f132a1-33f8-41a3-93f0-94c77d6501e4'} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:51 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 1073741824" returned: 0 in 0.614s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:51 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 Sep 10 20:13:51 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Flow 'volume_create_manager' (51f7e9ae-0406-4197-a9b3-881e7cb67bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f72c4d-cb72-46d5-89c2-fc330f026160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f72c4d-cb72-46d5-89c2-fc330f026160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-764563965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f061461-e02b-46be-a809-29b38d3c18ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd2a0220f2643ebb7a7418998314fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:52Z,use_quota=True,user_id='47432c9ff61d498d8821ebf85639cd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66fee53f-3810-4b0b-aff3-3055e1691a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66fee53f-3810-4b0b-aff3-3055e1691a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36a829e-8e87-42de-93e0-51f9309f13ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36a829e-8e87-42de-93e0-51f9309f13ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f061461-e02b-46be-a809-29b38d3c18ae', 'volume_name': 'volume-4f061461-e02b-46be-a809-29b38d3c18ae', 'volume_size': 2}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40dd093-38ed-43b6-bb37-9401a4806883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40dd093-38ed-43b6-bb37-9401a4806883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b2509-e78b-440a-9e48-892aa68b0c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:52 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Volume 4f061461-e02b-46be-a809-29b38d3c18ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f061461-e02b-46be-a809-29b38d3c18ae', 'volume_size': 2} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:52 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2" returned: 0 in 0.281s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.864s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-83f132a1-33f8-41a3-93f0-94c77d6501e4-dc4c2733-2ced-44e8-882b-8810d45b78a6" by "_create_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48251b27-1e14-4ef8-9120-d599e3b00138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b972b4-122e-47c6-ba22-a17b6506fcb2', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf54d80-370c-415e-bfa2-2f46feceaa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-83f132a1-33f8-41a3-93f0-94c77d6501e4-dc4c2733-2ced-44e8-882b-8810d45b78a6" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Creating volume dc4c2733-2ced-44e8-882b-8810d45b78a6 from snapshot 83f132a1-33f8-41a3-93f0-94c77d6501e4 {{(pid=88137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-dc4c2733-2ced-44e8-882b-8810d45b78a6" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:52 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Volume volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 (04b972b4-122e-47c6-ba22-a17b6506fcb2): created successfully Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf54d80-370c-415e-bfa2-2f46feceaa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Flow 'volume_create_manager' (35652da8-8258-43ee-ba77-ffb33db7f46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-dc4c2733-2ced-44e8-882b-8810d45b78a6" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] snapshot: 83f132a1-33f8-41a3-93f0-94c77d6501e4, volume: dc4c2733-2ced-44e8-882b-8810d45b78a6, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:13:52 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5bcc8323-9dfd-4bbe-88ce-3cb01cd1d6a8 tempest-VolumesActionsTest-1735657952 None] Created volume successfully. Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a266b3-d956-4059-bfcc-ba158fdb362f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:52 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 Sep 10 20:13:52 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:52 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4" returned: 0 in 0.480s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[77684d9c-3182-4cac-9a87-decd19b8e1cc]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:52 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 Sep 10 20:13:52 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:53 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" returned: 0 in 0.437s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:53 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 Sep 10 20:13:53 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Acquiring lock "cinder-04b972b4-122e-47c6-ba22-a17b6506fcb2-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Lock "cinder-04b972b4-122e-47c6-ba22-a17b6506fcb2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Acquiring lock "cinder-quobyte-04b972b4-122e-47c6-ba22-a17b6506fcb2" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Lock "cinder-quobyte-04b972b4-122e-47c6-ba22-a17b6506fcb2" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[209089f8-b57f-4c4b-bf47-50661b2519a3]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:13:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:53 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 Sep 10 20:13:53 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:54 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2" returned: 0 in 1.015s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:54 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2 Sep 10 20:13:54 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:55 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-04b972b4-122e-47c6-ba22-a17b6506fcb2" returned: 0 in 0.699s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Lock "cinder-quobyte-04b972b4-122e-47c6-ba22-a17b6506fcb2" released by "delete_volume" :: held 1.791s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:55 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Created reservations ['b776b49c-d788-4524-b684-eb188a36ddcf', '3ffb2089-10eb-4e7b-98a5-7539144495dd', '4f823745-785d-4307-801b-ea2f7f552fec', '927cac9e-4d8d-4f3c-b5d4-e292c2d77d40'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:13:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:55 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:13:55 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:56 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.791s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:56 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:13:56 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Deleted volume successfully. Sep 10 20:13:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a615fe73-ae4d-4da0-b1b6-a553f17b8eab tempest-VolumesActionsTest-1735657952 None] Lock "cinder-04b972b4-122e-47c6-ba22-a17b6506fcb2-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:59 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6" returned: 0 in 5.814s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:13:59 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Converted 1024.00 MB image at 176.04 MB/s Sep 10 20:13:59 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 is being set with open permissions: ugo+rw Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:59 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 Sep 10 20:13:59 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:59 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6" returned: 0 in 0.290s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-dc4c2733-2ced-44e8-882b-8810d45b78a6" released by "_copy_volume_from_snapshot" :: held 7.149s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=151,cinder:UPDATE=176,cinder:DELETE=18,cinder:INSERT=43 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-83f132a1-33f8-41a3-93f0-94c77d6501e4-dc4c2733-2ced-44e8-882b-8810d45b78a6" released by "_create_volume_from_snapshot" :: held 7.242s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.279s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.291s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-764563965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f061461-e02b-46be-a809-29b38d3c18ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd2a0220f2643ebb7a7418998314fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:13:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:13:52Z,use_quota=True,user_id='47432c9ff61d498d8821ebf85639cd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Creating volume 4f061461-e02b-46be-a809-29b38d3c18ae {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:13:59 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae 2147483648 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:13:59 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae 2147483648 Sep 10 20:13:59 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b811923-7e27-46cb-a4ef-1e5ef2498cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4c2733-2ced-44e8-882b-8810d45b78a6', 'volume_size': 1, 'snapshot_id': '83f132a1-33f8-41a3-93f0-94c77d6501e4'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d427f9e3-476a-487d-8d06-4e5aaa7606f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:13:59 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Volume volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 (dc4c2733-2ced-44e8-882b-8810d45b78a6): created successfully Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d427f9e3-476a-487d-8d06-4e5aaa7606f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:13:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Flow 'volume_create_manager' (4d5a1433-b1ec-4073-8d2c-cd25a74e6094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:13:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d8ad1e4d-3145-4a72-83a5-9bf512a19c3a tempest-VolumesSnapshotTestJSON-1586022467 None] Created volume successfully. Sep 10 20:14:00 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae 2147483648" returned: 0 in 0.628s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:00 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae Sep 10 20:14:00 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-dc4c2733-2ced-44e8-882b-8810d45b78a6-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-dc4c2733-2ced-44e8-882b-8810d45b78a6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-dc4c2733-2ced-44e8-882b-8810d45b78a6" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-dc4c2733-2ced-44e8-882b-8810d45b78a6" acquired by "delete_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:00 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae" returned: 0 in 0.298s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b2509-e78b-440a-9e48-892aa68b0c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f061461-e02b-46be-a809-29b38d3c18ae', 'volume_size': 2}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c427f680-9d32-40ac-850e-c62b816a25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bff6bd-c857-43f2-9804-c77941ea7eeb]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:00 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Volume volume-4f061461-e02b-46be-a809-29b38d3c18ae (4f061461-e02b-46be-a809-29b38d3c18ae): created successfully Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c427f680-9d32-40ac-850e-c62b816a25fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Flow 'volume_create_manager' (51f7e9ae-0406-4197-a9b3-881e7cb67bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:00 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a915f4c2-2e2f-4b97-a87a-f4f56f691933 tempest-VolumesCloneNegativeTest-991702206 None] Created volume successfully. Sep 10 20:14:00 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 Sep 10 20:14:00 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:00 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6" returned: 0 in 0.394s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:00 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6 Sep 10 20:14:00 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:01 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Acquiring lock "cinder-4f061461-e02b-46be-a809-29b38d3c18ae-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dc4c2733-2ced-44e8-882b-8810d45b78a6" returned: 0 in 0.396s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-dc4c2733-2ced-44e8-882b-8810d45b78a6" released by "delete_volume" :: held 0.859s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Lock "cinder-4f061461-e02b-46be-a809-29b38d3c18ae-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Acquiring lock "cinder-quobyte-4f061461-e02b-46be-a809-29b38d3c18ae" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Created reservations ['0eef8ab3-898f-48d4-a22c-e260799ba745', '49e9b15f-ce49-403a-bb99-d56825329867', '42e78445-b62c-4ade-baf6-ceadbf05bb55', '5811739f-940d-43bd-927b-6228e5a137a5'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Lock "cinder-quobyte-4f061461-e02b-46be-a809-29b38d3c18ae" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[969dfdde-d3c6-4ae6-b839-202e6723b450]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:01 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:01 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:01 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae Sep 10 20:14:01 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:01 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.257s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Deleted volume successfully. Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09b25215-bfde-40b6-b340-0d255181cfdd tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-dc4c2733-2ced-44e8-882b-8810d45b78a6-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:01 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae" returned: 0 in 0.423s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:01 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae Sep 10 20:14:01 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:02 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4f061461-e02b-46be-a809-29b38d3c18ae" returned: 0 in 0.332s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Lock "cinder-quobyte-4f061461-e02b-46be-a809-29b38d3c18ae" released by "delete_volume" :: held 0.814s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Created reservations ['da9ee452-679a-4507-a6ca-e4644199a31a', '28c32417-ce6a-4e3f-84c5-4147747e2110', 'ed960439-4e01-4660-984f-159be8c828b6', '6657a50f-9039-48b7-863e-85d34eede255'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:02 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:02 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-83f132a1-33f8-41a3-93f0-94c77d6501e4-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-83f132a1-33f8-41a3-93f0-94c77d6501e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:02 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.400s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-83f132a1-33f8-41a3-93f0-94c77d6501e4" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:02 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Deleted volume successfully. Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-83f132a1-33f8-41a3-93f0-94c77d6501e4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Deleting offline snapshot 83f132a1-33f8-41a3-93f0-94c77d6501e4 of volume e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] snapshot_file for this snap is: volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-650534a4-c192-4fd8-bf5c-dfec9fb05d39 tempest-VolumesCloneNegativeTest-991702206 None] Lock "cinder-4f061461-e02b-46be-a809-29b38d3c18ae-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab540ed2-6b56-4b71-852e-da59f47b50b2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:02 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 Sep 10 20:14:02 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:03 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4" returned: 0 in 0.583s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:14:03 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d31c0f-2ab8-4944-8a9e-326b6609d603]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:03 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 Sep 10 20:14:03 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:04 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" returned: 0 in 0.667s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:04 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 Sep 10 20:14:04 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:04 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4" returned: 0 in 0.379s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:04 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4 Sep 10 20:14:04 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:04 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1.83f132a1-33f8-41a3-93f0-94c77d6501e4" returned: 0 in 0.270s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-83f132a1-33f8-41a3-93f0-94c77d6501e4" released by "_delete_snapshot" :: held 2.032s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" released by "delete_snapshot" :: held 2.076s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:04 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Created reservations ['463675c5-0121-4420-b52e-83a8de18a307', '98043f07-2349-4e0f-b360-73d065b4ab96', '536e30d8-2f31-4757-a4b8-5675e4ae0aa4', 'e8d007a3-5733-4c09-8d54-650b4c516888'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:04 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Delete snapshot completed successfully. Sep 10 20:14:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e01f0d3c-7427-46ac-b249-ec3035d731ef tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-83f132a1-33f8-41a3-93f0-94c77d6501e4-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-e1f8167d-d672-448e-ab89-d2d6b2f9aea1-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-e1f8167d-d672-448e-ab89-d2d6b2f9aea1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" acquired by "delete_volume" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:06 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf159ca9-d232-469b-9a87-75dc63a7adb3]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:06 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 Sep 10 20:14:06 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:06 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" returned: 0 in 0.550s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:06 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1 Sep 10 20:14:06 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:06 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" returned: 0 in 0.279s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-e1f8167d-d672-448e-ab89-d2d6b2f9aea1" released by "delete_volume" :: held 0.910s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Created reservations ['59dc3dd9-9326-4f31-82b6-7e1c7a7d37d6', '75b34475-f815-40c2-aeba-0c03fc943a97', 'd500d9c6-732c-479f-9821-5ccf457370ab', 'e140bae8-99d7-4cbc-afbb-67c8a39f7af7'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:07 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:07 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:07 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.298s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Deleted volume successfully. Sep 10 20:14:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cb6784f2-e48d-49b3-bff7-7a8320a772d3 tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-e1f8167d-d672-448e-ab89-d2d6b2f9aea1-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-4cf25c50-8818-469a-bb8b-1b9a759301bd-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-4cf25c50-8818-469a-bb8b-1b9a759301bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "cinder-quobyte-4cf25c50-8818-469a-bb8b-1b9a759301bd" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-4cf25c50-8818-469a-bb8b-1b9a759301bd" acquired by "delete_volume" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[98953487-6308-40b7-8924-2837ce54137b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:08 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd Sep 10 20:14:08 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Flow 'volume_create_manager' (6dfce99f-f066-4eab-be05-6b2626a70fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebf18c6-5d4d-4e17-a5bf-c7c58124d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebf18c6-5d4d-4e17-a5bf-c7c58124d556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2136496793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cde3a02-148a-4730-a8d0-48486f428c44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e787db01856b49ab999a5475fb1dcb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:09Z,use_quota=True,user_id='619cd315846a468698e13aff18cedfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb48ca67-b220-44c3-9535-d27a7fbcc938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb48ca67-b220-44c3-9535-d27a7fbcc938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a523b7-875f-48f5-afa5-945d45de0ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a523b7-875f-48f5-afa5-945d45de0ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cde3a02-148a-4730-a8d0-48486f428c44', 'volume_name': 'volume-2cde3a02-148a-4730-a8d0-48486f428c44', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7df5dd-38f7-4432-80ff-cb078a3e56c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7df5dd-38f7-4432-80ff-cb078a3e56c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ddc585-4b38-45ba-99bf-6e30396863b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:08 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Volume 2cde3a02-148a-4730-a8d0-48486f428c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cde3a02-148a-4730-a8d0-48486f428c44', 'volume_size': 1} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2136496793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cde3a02-148a-4730-a8d0-48486f428c44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e787db01856b49ab999a5475fb1dcb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:09Z,use_quota=True,user_id='619cd315846a468698e13aff18cedfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Creating volume 2cde3a02-148a-4730-a8d0-48486f428c44 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:14:08 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:14:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:08 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44 1073741824 Sep 10 20:14:08 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:09 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd" returned: 0 in 0.487s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:09 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd Sep 10 20:14:09 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:09 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4cf25c50-8818-469a-bb8b-1b9a759301bd" returned: 0 in 0.329s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:09 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44 1073741824" returned: 0 in 0.573s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-quobyte-4cf25c50-8818-469a-bb8b-1b9a759301bd" released by "delete_volume" :: held 0.895s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Created reservations ['478071d4-d989-4958-a01a-a585762cbdaf', '482aed94-c82d-4b8d-9dd6-1f7991ebfe04', 'fb20776e-cbda-4845-801e-cf28bec91e53', 'f8130add-90e1-49d0-b228-c65b43deb798'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:09 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44 Sep 10 20:14:09 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:09 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:09 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:09 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44" returned: 0 in 0.343s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ddc585-4b38-45ba-99bf-6e30396863b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cde3a02-148a-4730-a8d0-48486f428c44', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5735a6c-1f35-4cc5-a8da-d0193bf3daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:09 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Volume volume-2cde3a02-148a-4730-a8d0-48486f428c44 (2cde3a02-148a-4730-a8d0-48486f428c44): created successfully Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5735a6c-1f35-4cc5-a8da-d0193bf3daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Flow 'volume_create_manager' (6dfce99f-f066-4eab-be05-6b2626a70fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:09 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-24c3664d-2797-4330-93c7-d03b539231ae tempest-VolumesListTestJSON-1262840469 None] Created volume successfully. Sep 10 20:14:09 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.350s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:09 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Deleted volume successfully. Sep 10 20:14:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-326332c3-874a-40e4-8e9a-bd1b18bb8b2a tempest-VolumesSnapshotTestJSON-1586022467 None] Lock "cinder-4cf25c50-8818-469a-bb8b-1b9a759301bd-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Flow 'volume_create_manager' (9f0f80d9-3356-4b0c-ad9c-c49589bad413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f40736-3b18-4c02-94ca-d5af65f768fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f40736-3b18-4c02-94ca-d5af65f768fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2113346779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a12db9-cdb0-4637-9da5-ed2460709787,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e787db01856b49ab999a5475fb1dcb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:11Z,use_quota=True,user_id='619cd315846a468698e13aff18cedfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d045bb93-4322-4828-b1ea-8885e4e3bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d045bb93-4322-4828-b1ea-8885e4e3bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a206d2-65fb-4f35-9c2b-671d484821b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a206d2-65fb-4f35-9c2b-671d484821b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a12db9-cdb0-4637-9da5-ed2460709787', 'volume_name': 'volume-c8a12db9-cdb0-4637-9da5-ed2460709787', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30273af3-8410-42d2-af31-c5f13f1d5d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30273af3-8410-42d2-af31-c5f13f1d5d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006a206c-1b2c-447b-b601-974227df6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:11 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Volume c8a12db9-cdb0-4637-9da5-ed2460709787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a12db9-cdb0-4637-9da5-ed2460709787', 'volume_size': 1} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2113346779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a12db9-cdb0-4637-9da5-ed2460709787,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e787db01856b49ab999a5475fb1dcb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:11Z,use_quota=True,user_id='619cd315846a468698e13aff18cedfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Creating volume c8a12db9-cdb0-4637-9da5-ed2460709787 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:14:11 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:14:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:11 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787 1073741824 Sep 10 20:14:11 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:12 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787 1073741824" returned: 0 in 0.535s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:12 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787 Sep 10 20:14:12 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:12 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787" returned: 0 in 0.285s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:14:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006a206c-1b2c-447b-b601-974227df6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a12db9-cdb0-4637-9da5-ed2460709787', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3938eb-b9c2-45d8-9e1d-f14c75c5c8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:12 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Volume volume-c8a12db9-cdb0-4637-9da5-ed2460709787 (c8a12db9-cdb0-4637-9da5-ed2460709787): created successfully Sep 10 20:14:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3938eb-b9c2-45d8-9e1d-f14c75c5c8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Flow 'volume_create_manager' (9f0f80d9-3356-4b0c-ad9c-c49589bad413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ed4a1af7-a40b-45b7-a52f-fa29ea7d81ae tempest-VolumesListTestJSON-1262840469 None] Created volume successfully. Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Flow 'volume_create_manager' (a4fbddc6-9495-462e-af1a-716ac99cf1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5e2e22-4df5-4c41-bbef-ebf51c4b060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5e2e22-4df5-4c41-bbef-ebf51c4b060e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1126569219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c3515f-66b8-452b-acfe-1a8004f213d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e787db01856b49ab999a5475fb1dcb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:14Z,use_quota=True,user_id='619cd315846a468698e13aff18cedfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06b6d33-9f9c-43d5-8b5f-aecc89a2f6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06b6d33-9f9c-43d5-8b5f-aecc89a2f6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c9dcaa-c3c3-4386-ad1e-4a5cb4dad687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c9dcaa-c3c3-4386-ad1e-4a5cb4dad687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c3515f-66b8-452b-acfe-1a8004f213d6', 'volume_name': 'volume-d9c3515f-66b8-452b-acfe-1a8004f213d6', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1896b487-1c1d-4a73-9036-077c5d778200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1896b487-1c1d-4a73-9036-077c5d778200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba8c4c6-d89d-41e6-933c-9f944a180ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:14 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Volume d9c3515f-66b8-452b-acfe-1a8004f213d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c3515f-66b8-452b-acfe-1a8004f213d6', 'volume_size': 1} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1126569219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c3515f-66b8-452b-acfe-1a8004f213d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e787db01856b49ab999a5475fb1dcb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:14Z,use_quota=True,user_id='619cd315846a468698e13aff18cedfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Creating volume d9c3515f-66b8-452b-acfe-1a8004f213d6 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:14:14 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:14:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:14 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 1073741824 Sep 10 20:14:14 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:15 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 1073741824" returned: 0 in 0.701s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:15 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 Sep 10 20:14:15 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:15 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6" returned: 0 in 0.323s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:14:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba8c4c6-d89d-41e6-933c-9f944a180ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c3515f-66b8-452b-acfe-1a8004f213d6', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9dd182-2371-4901-97ed-0a414e348b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:15 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Volume volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 (d9c3515f-66b8-452b-acfe-1a8004f213d6): created successfully Sep 10 20:14:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9dd182-2371-4901-97ed-0a414e348b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Flow 'volume_create_manager' (a4fbddc6-9495-462e-af1a-716ac99cf1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:15 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-29c4594e-9e31-4f28-a80f-350505a381b6 tempest-VolumesListTestJSON-1262840469 None] Created volume successfully. Sep 10 20:14:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "cinder-d9c3515f-66b8-452b-acfe-1a8004f213d6-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-d9c3515f-66b8-452b-acfe-1a8004f213d6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:19 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=200,cinder:SELECT=132,cinder:DELETE=13,cinder:INSERT=43 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:14:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "cinder-quobyte-d9c3515f-66b8-452b-acfe-1a8004f213d6" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-quobyte-d9c3515f-66b8-452b-acfe-1a8004f213d6" acquired by "delete_volume" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:19 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8f0461-b92c-4281-bcd0-d8684e102408]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:19 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 Sep 10 20:14:19 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:20 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6" returned: 0 in 0.513s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:20 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6 Sep 10 20:14:20 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:20 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d9c3515f-66b8-452b-acfe-1a8004f213d6" returned: 0 in 0.432s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:20 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:20 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-quobyte-d9c3515f-66b8-452b-acfe-1a8004f213d6" released by "delete_volume" :: held 1.042s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Created reservations ['75cfac11-a587-4fec-b004-fd597cf22ae2', 'd21069b9-bf1d-40f0-b435-95fb809368ee', 'a7b2c350-31de-45cd-8d3d-9e0b1439db66', '41aad85d-9a8c-40b2-a670-c227db4a6ca6'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:20 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:20 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:20 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.490s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:14:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:14:21 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.482s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:21 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Deleted volume successfully. Sep 10 20:14:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a35f53fa-0667-4d6f-9756-56ff617828f2 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-d9c3515f-66b8-452b-acfe-1a8004f213d6-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "cinder-c8a12db9-cdb0-4637-9da5-ed2460709787-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-c8a12db9-cdb0-4637-9da5-ed2460709787-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "cinder-quobyte-c8a12db9-cdb0-4637-9da5-ed2460709787" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-quobyte-c8a12db9-cdb0-4637-9da5-ed2460709787" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:21 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[351fe928-28d5-4946-95c1-a0b194b5fe6c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:22 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787 Sep 10 20:14:22 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:22 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787" returned: 0 in 0.555s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:22 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787 Sep 10 20:14:22 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:22 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c8a12db9-cdb0-4637-9da5-ed2460709787" returned: 0 in 0.355s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-quobyte-c8a12db9-cdb0-4637-9da5-ed2460709787" released by "delete_volume" :: held 0.998s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Created reservations ['313c5df4-57f8-47f4-804c-d58113143e33', 'b4aae2e7-7845-4b28-8ec1-74f53655e3e3', '1e4459c3-9e1a-4fee-ac5c-07546999e912', '624a5692-95e8-468e-8e7d-612fb5a6b2dc'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:23 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:23 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Flow 'volume_create_manager' (ee1d607f-4ce6-41b6-b820-0b827aaccc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82267b2-d21b-4166-ab55-9107aa0acd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82267b2-d21b-4166-ab55-9107aa0acd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-64535689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb56a8e6-c24a-44d4-bcf2-06d01c2b372a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904c14e9a48460bab37c8f89f337062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:23Z,use_quota=True,user_id='9550674eb8c042e9a2902c3420f56316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7522aa0d-61d4-4bd3-af7d-49e0da35a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7522aa0d-61d4-4bd3-af7d-49e0da35a417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e55dd16-9258-4118-9f36-f81bc45bf377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:14:23 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Deleted volume successfully. Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3a795fa3-6b74-44b5-89bf-34e792027b53 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-c8a12db9-cdb0-4637-9da5-ed2460709787-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e55dd16-9258-4118-9f36-f81bc45bf377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb56a8e6-c24a-44d4-bcf2-06d01c2b372a', 'volume_name': 'volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5542ac5f-3b1b-46f5-a8e2-5253dd663fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5542ac5f-3b1b-46f5-a8e2-5253dd663fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5a6633-0d18-4729-9abb-f265a00cc6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:23 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Volume fb56a8e6-c24a-44d4-bcf2-06d01c2b372a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 20:14:23 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Trying to clone fb56a8e6-c24a-44d4-bcf2-06d01c2b372a from image c78ee229-c276-4323-b914-d91a23a49bd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:14:24 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Image download 20.69 MB at 20.69 MB/s Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7214384a-731a-4349-910a-e5b5dd66a4d2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "cinder-2cde3a02-148a-4730-a8d0-48486f428c44-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-2cde3a02-148a-4730-a8d0-48486f428c44-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:24 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD Sep 10 20:14:24 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "cinder-quobyte-2cde3a02-148a-4730-a8d0-48486f428c44" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-quobyte-2cde3a02-148a-4730-a8d0-48486f428c44" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81b701f-f065-40e8-9816-1b96c48d0ebf]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:24 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD" returned: 0 in 0.665s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:24 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 is fetched for user 9550674eb8c042e9a2902c3420f56316. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:14:24 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44 Sep 10 20:14:24 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd3fa3-454d-4719-8999-de5cf8c28af1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:25 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD Sep 10 20:14:25 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:25 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44" returned: 0 in 0.811s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:25 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44 Sep 10 20:14:25 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:25 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-64535689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb56a8e6-c24a-44d4-bcf2-06d01c2b372a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904c14e9a48460bab37c8f89f337062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:23Z,use_quota=True,user_id='9550674eb8c042e9a2902c3420f56316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Creating volume fb56a8e6-c24a-44d4-bcf2-06d01c2b372a {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:14:25 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:14:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:25 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a 1073741824 Sep 10 20:14:25 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:26 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cde3a02-148a-4730-a8d0-48486f428c44" returned: 0 in 0.585s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-quobyte-2cde3a02-148a-4730-a8d0-48486f428c44" released by "delete_volume" :: held 1.521s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Created reservations ['c15012fe-ee63-4614-92b9-9374f9c60a0f', 'ab76ab1f-8bd9-4074-89d9-88157ee5b6ee', '5fb5cd81-2dec-46c9-96d4-9a59f7505e65', '0fbc9a3b-364c-48b4-b88f-d75ef5d0245e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:26 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:26 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:26 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.572s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:26 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Deleted volume successfully. Sep 10 20:14:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-91e9cd06-f374-431e-a317-d12e251bc989 tempest-VolumesListTestJSON-1262840469 None] Lock "cinder-2cde3a02-148a-4730-a8d0-48486f428c44-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:27 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a 1073741824" returned: 0 in 1.220s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:27 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a Sep 10 20:14:27 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:27 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a" returned: 0 in 0.408s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:14:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:27 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Attempting download of c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume fb56a8e6-c24a-44d4-bcf2-06d01c2b372a. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:14:27 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[267286b2-17b3-48e2-abfa-7c69d74f0254]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_g7qrngik {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:27 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_g7qrngik Sep 10 20:14:27 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:28 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_g7qrngik" returned: 0 in 0.490s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_g7qrngik {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:28 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_g7qrngik Sep 10 20:14:28 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:28 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_g7qrngik" returned: 1 in 0.510s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_g7qrngik' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:14:28 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e38042-6638-4c3f-8065-3eb31fcc3d05]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:28 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD Sep 10 20:14:28 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:29 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:29 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] c78ee229-c276-4323-b914-d91a23a49bd6 was qcow2, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:14:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:29 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a Sep 10 20:14:29 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:32 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a" returned: 0 in 2.965s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_dy7zrt3idevstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:14:32 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Converted 112.00 MB image at 37.77 MB/s Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:32 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a 1G Sep 10 20:14:32 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:32 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a 1G" returned: 0 in 0.480s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Downloaded image c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume fb56a8e6-c24a-44d4-bcf2-06d01c2b372a successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 for user 9550674eb8c042e9a2902c3420f56316 is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Marking volume fb56a8e6-c24a-44d4-bcf2-06d01c2b372a as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Copying metadata from image c78ee229-c276-4323-b914-d91a23a49bd6 to fb56a8e6-c24a-44d4-bcf2-06d01c2b372a. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Creating volume glance metadata for volume fb56a8e6-c24a-44d4-bcf2-06d01c2b372a backed by image c78ee229-c276-4323-b914-d91a23a49bd6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5a6633-0d18-4729-9abb-f265a00cc6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d736ae-5401-4321-9e5c-1e6a814eada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Volume volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a (fb56a8e6-c24a-44d4-bcf2-06d01c2b372a): created successfully Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d736ae-5401-4321-9e5c-1e6a814eada4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Flow 'volume_create_manager' (ee1d607f-4ce6-41b6-b820-0b827aaccc1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:32 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4013e0b8-dd8a-4f59-870d-28e72d3fd2b7 tempest-VolumesImageMetadata-1881831569 None] Created volume successfully. Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Flow 'volume_create_manager' (5ee0ac1a-c078-439e-b7fe-da735f7e0878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c7c4f4-3247-480e-b84b-a98f126c23b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c7c4f4-3247-480e-b84b-a98f126c23b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1702009376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6712bf75-e633-42be-bc8c-6ea1d7275a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b4e3c8608e423fa607c766f2f09af2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:34Z,use_quota=True,user_id='5d076104f354442a832a2def69bab90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2791006e-d169-445c-82fa-59ddca02ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2791006e-d169-445c-82fa-59ddca02ce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a22140-fb9b-4a7f-9b3e-e261e3ac4a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a22140-fb9b-4a7f-9b3e-e261e3ac4a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6712bf75-e633-42be-bc8c-6ea1d7275a71', 'volume_name': 'volume-6712bf75-e633-42be-bc8c-6ea1d7275a71', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2422252e-9707-46ab-8313-6a7836c0f538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2422252e-9707-46ab-8313-6a7836c0f538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4291a942-c9e7-4e4e-9508-eb7addd8619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Volume 6712bf75-e633-42be-bc8c-6ea1d7275a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6712bf75-e633-42be-bc8c-6ea1d7275a71', 'volume_size': 1} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1702009376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6712bf75-e633-42be-bc8c-6ea1d7275a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b4e3c8608e423fa607c766f2f09af2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:34Z,use_quota=True,user_id='5d076104f354442a832a2def69bab90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Creating volume 6712bf75-e633-42be-bc8c-6ea1d7275a71 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:14:33 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:14:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:33 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 1073741824 Sep 10 20:14:33 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Acquiring lock "cinder-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Lock "cinder-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Acquiring lock "cinder-quobyte-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Lock "cinder-quobyte-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[130e565c-0019-4a0e-a610-1ac57cbb57e1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 1073741824" returned: 0 in 0.644s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:34 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:34 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 Sep 10 20:14:34 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:34 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a Sep 10 20:14:34 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:35 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a" returned: 0 in 0.511s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:35 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71" returned: 0 in 0.420s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:35 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a Sep 10 20:14:35 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4291a942-c9e7-4e4e-9508-eb7addd8619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6712bf75-e633-42be-bc8c-6ea1d7275a71', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c201bfff-3b35-4acb-add1-305a74780313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:35 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Volume volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 (6712bf75-e633-42be-bc8c-6ea1d7275a71): created successfully Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c201bfff-3b35-4acb-add1-305a74780313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Flow 'volume_create_manager' (5ee0ac1a-c078-439e-b7fe-da735f7e0878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f7278479-551c-45fa-b5ec-ba3f4b67adbf tempest-VolumesNegativeTest-469301132 None] Created volume successfully. Sep 10 20:14:35 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a" returned: 0 in 0.287s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Lock "cinder-quobyte-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a" released by "delete_volume" :: held 0.858s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Created reservations ['f6ebb5c4-107f-4dec-8f57-028564135999', '9e42e19e-1879-476a-85e3-7539458fd702', '86cf26ad-135c-461b-b7c4-5b61bd0b5b7c', '30e19aa7-a006-4a99-a0a2-e5e7d0ed140d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:35 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:35 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:36 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.563s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:36 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Deleted volume successfully. Sep 10 20:14:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-01200360-b43f-4d9b-b646-916569f94d45 tempest-VolumesImageMetadata-1881831569 None] Lock "cinder-fb56a8e6-c24a-44d4-bcf2-06d01c2b372a-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Flow 'volume_create_manager' (8fb6dab4-7239-4af5-9bf3-78a86c3fabcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c11950b-59e3-4462-90ff-b654d52e05a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c11950b-59e3-4462-90ff-b654d52e05a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1615415007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7018c7f-00b7-4c29-86de-a627292a800c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976be863d8a2413ba51c73d768510a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:42Z,use_quota=True,user_id='03883e46e92444da9d2bda7524430693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a4722-7bc6-4fa8-9ddc-5849baa582ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a4722-7bc6-4fa8-9ddc-5849baa582ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a556f7a-8861-4e66-8621-c84330ec1c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a556f7a-8861-4e66-8621-c84330ec1c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7018c7f-00b7-4c29-86de-a627292a800c', 'volume_name': 'volume-d7018c7f-00b7-4c29-86de-a627292a800c', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4a5ae8-0910-4ee8-a58e-184ca85a768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4a5ae8-0910-4ee8-a58e-184ca85a768b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1e660c-9d85-4890-bb81-b53d8405a3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:41 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Volume d7018c7f-00b7-4c29-86de-a627292a800c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7018c7f-00b7-4c29-86de-a627292a800c', 'volume_size': 1} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1615415007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7018c7f-00b7-4c29-86de-a627292a800c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976be863d8a2413ba51c73d768510a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:42Z,use_quota=True,user_id='03883e46e92444da9d2bda7524430693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Creating volume d7018c7f-00b7-4c29-86de-a627292a800c {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:14:41 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:14:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:41 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c 1073741824 Sep 10 20:14:41 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:42 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c 1073741824" returned: 0 in 0.510s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:42 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c Sep 10 20:14:42 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:42 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c" returned: 0 in 0.350s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:14:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1e660c-9d85-4890-bb81-b53d8405a3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7018c7f-00b7-4c29-86de-a627292a800c', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52335042-fc86-49b7-bca6-1af8e844e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:42 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Volume volume-d7018c7f-00b7-4c29-86de-a627292a800c (d7018c7f-00b7-4c29-86de-a627292a800c): created successfully Sep 10 20:14:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52335042-fc86-49b7-bca6-1af8e844e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Flow 'volume_create_manager' (8fb6dab4-7239-4af5-9bf3-78a86c3fabcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:42 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3b2e01dc-ea8b-44e4-982f-80fdda9349f0 tempest-SnapshotMetadataTestJSON-1861416140 None] Created volume successfully. Sep 10 20:14:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Creating offline snapshot 401b746e-def3-4640-b8ff-336392bf08c2 of volume d7018c7f-00b7-4c29-86de-a627292a800c {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:14:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a2d8b-e917-4347-93c9-da1ce08c809e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:44 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c Sep 10 20:14:44 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:44 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c" returned: 0 in 0.478s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:44 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 1G Sep 10 20:14:44 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:45 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 1G" returned: 0 in 0.590s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7018c7f-00b7-4c29-86de-a627292a800c -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:45 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7018c7f-00b7-4c29-86de-a627292a800c -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 Sep 10 20:14:45 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:45 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7018c7f-00b7-4c29-86de-a627292a800c -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2" returned: 0 in 0.492s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:45 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 is being set with open permissions: ugo+rw Sep 10 20:14:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:46 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 Sep 10 20:14:46 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:46 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2" returned: 0 in 0.610s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:46 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.info Sep 10 20:14:46 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:47 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.info" returned: 0 in 0.547s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:47 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.info is being set with open permissions: ugo+rw Sep 10 20:14:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:47 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.info Sep 10 20:14:47 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:47 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.info" returned: 0 in 0.583s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.464s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:47 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8e830312-e70c-4d9b-b924-f58e3d278947 tempest-SnapshotMetadataTestJSON-1861416140 None] Create snapshot completed successfully Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Acquiring lock "cinder-401b746e-def3-4640-b8ff-336392bf08c2-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-401b746e-def3-4640-b8ff-336392bf08c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Acquiring lock "cinder-quobyte-d7018c7f-00b7-4c29-86de-a627292a800c" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-quobyte-d7018c7f-00b7-4c29-86de-a627292a800c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Acquiring lock "cinder-quobyte-401b746e-def3-4640-b8ff-336392bf08c2" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-quobyte-401b746e-def3-4640-b8ff-336392bf08c2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Deleting offline snapshot 401b746e-def3-4640-b8ff-336392bf08c2 of volume d7018c7f-00b7-4c29-86de-a627292a800c {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] snapshot_file for this snap is: volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fd0725-0d94-4755-a51d-dccf75350ad2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:49 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 Sep 10 20:14:49 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:50 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2" returned: 0 in 0.475s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7018c7f-00b7-4c29-86de-a627292a800c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:14:50 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f419f8a-10f0-4bfc-ae3f-e4b89092490a]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:50 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c Sep 10 20:14:50 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:50 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c" returned: 0 in 0.571s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:50 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 Sep 10 20:14:50 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:51 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2" returned: 0 in 0.463s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:51 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2 Sep 10 20:14:51 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:51 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c.401b746e-def3-4640-b8ff-336392bf08c2" returned: 0 in 0.352s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-quobyte-401b746e-def3-4640-b8ff-336392bf08c2" released by "_delete_snapshot" :: held 2.046s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-quobyte-d7018c7f-00b7-4c29-86de-a627292a800c" released by "delete_snapshot" :: held 2.078s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:51 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Created reservations ['38e236e7-a057-4575-ac42-bf8dfb62dcc5', '610c715c-ddaa-482b-b47b-92e2e579cd2d', 'a8e6d5d8-8230-44b3-ba2f-00c15a604f62', 'a965ed21-e8d7-4d5a-885c-66329b11681f'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Delete snapshot completed successfully. Sep 10 20:14:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-aef515dc-6e3f-4c1d-b43c-891e41fbfde3 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-401b746e-def3-4640-b8ff-336392bf08c2-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Flow 'volume_create_manager' (c5c9209b-a1e0-4ad3-9064-0288c988dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89efbab8-8d69-433a-ae6f-c5c3ef325134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89efbab8-8d69-433a-ae6f-c5c3ef325134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-917742744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef0c087-3f79-426c-b9a4-df9d935c2c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148e0b0dc5834fabbbc5714fa21ea6c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:53Z,use_quota=True,user_id='c9bf78f4ac0e441684eb139d09337974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5422dd66-b4c1-482c-8631-1f42f6661ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5422dd66-b4c1-482c-8631-1f42f6661ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d40d53d-045b-4e09-8ef2-2030e880e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d40d53d-045b-4e09-8ef2-2030e880e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef0c087-3f79-426c-b9a4-df9d935c2c62', 'volume_name': 'volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd0e7a4-6b36-4252-9ec0-801a4aca882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd0e7a4-6b36-4252-9ec0-801a4aca882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d8c112-0722-426a-94fb-4da024c2af00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:52 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Volume 2ef0c087-3f79-426c-b9a4-df9d935c2c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62', 'volume_size': 1} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-917742744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef0c087-3f79-426c-b9a4-df9d935c2c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148e0b0dc5834fabbbc5714fa21ea6c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:14:53Z,use_quota=True,user_id='c9bf78f4ac0e441684eb139d09337974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Creating volume 2ef0c087-3f79-426c-b9a4-df9d935c2c62 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:14:52 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:14:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:52 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 1073741824 Sep 10 20:14:52 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Acquiring lock "cinder-d7018c7f-00b7-4c29-86de-a627292a800c-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-d7018c7f-00b7-4c29-86de-a627292a800c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Acquiring lock "cinder-quobyte-d7018c7f-00b7-4c29-86de-a627292a800c" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-quobyte-d7018c7f-00b7-4c29-86de-a627292a800c" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8647a2-ee68-4128-a2c1-8ab5534a4a1c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:53 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c Sep 10 20:14:53 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:53 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 1073741824" returned: 0 in 0.595s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:53 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 Sep 10 20:14:53 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:53 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c" returned: 0 in 0.488s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:53 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c Sep 10 20:14:53 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:53 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62" returned: 0 in 0.306s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d8c112-0722-426a-94fb-4da024c2af00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bab6ba8-7788-4c51-bf50-c56f44bf8a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:14:53 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Volume volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 (2ef0c087-3f79-426c-b9a4-df9d935c2c62): created successfully Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bab6ba8-7788-4c51-bf50-c56f44bf8a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Flow 'volume_create_manager' (c5c9209b-a1e0-4ad3-9064-0288c988dcca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:14:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d0f305c2-65e2-40ef-9ab9-47f629b7e7a6 tempest-AttachVolumeNegativeTest-2145474300 None] Created volume successfully. Sep 10 20:14:53 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d7018c7f-00b7-4c29-86de-a627292a800c" returned: 0 in 0.284s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-quobyte-d7018c7f-00b7-4c29-86de-a627292a800c" released by "delete_volume" :: held 0.856s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Created reservations ['d347d2a8-aa50-458c-9f7d-4f8d75f3fa8f', 'c7368ceb-2cef-487c-b2a2-40144af14dad', '9072c067-8e49-42d8-a485-94f32e261310', '97f0f03d-4050-4174-9f4a-40ffa15f0ade'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:14:54 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:14:54 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:14:54 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.391s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:14:54 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Deleted volume successfully. Sep 10 20:14:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f64c0d2b-64eb-4d2b-b73f-b00b5bb655e4 tempest-SnapshotMetadataTestJSON-1861416140 None] Lock "cinder-d7018c7f-00b7-4c29-86de-a627292a800c-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:14:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-34ea9ee4-d31f-426e-b4b4-80e97e073edf req-9d9bf5a6-bd5c-4e52-8211-a8a79a9f914a tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:14:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-34ea9ee4-d31f-426e-b4b4-80e97e073edf req-9d9bf5a6-bd5c-4e52-8211-a8a79a9f914a tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:14:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-34ea9ee4-d31f-426e-b4b4-80e97e073edf req-9d9bf5a6-bd5c-4e52-8211-a8a79a9f914a tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:14:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-34ea9ee4-d31f-426e-b4b4-80e97e073edf req-9d9bf5a6-bd5c-4e52-8211-a8a79a9f914a tempest-AttachVolumeNegativeTest-2145474300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6526c724-ba90-4896-baa7-f49685c3e2a3', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:14:56 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-34ea9ee4-d31f-426e-b4b4-80e97e073edf req-9d9bf5a6-bd5c-4e52-8211-a8a79a9f914a tempest-AttachVolumeNegativeTest-2145474300 None] attachment_update completed successfully. Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Acquiring lock "cinder-6712bf75-e633-42be-bc8c-6ea1d7275a71-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Lock "cinder-6712bf75-e633-42be-bc8c-6ea1d7275a71-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=99,cinder:DELETE=7,cinder:SELECT=96,cinder:INSERT=39 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Acquiring lock "cinder-quobyte-6712bf75-e633-42be-bc8c-6ea1d7275a71" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Lock "cinder-quobyte-6712bf75-e633-42be-bc8c-6ea1d7275a71" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[876c1303-626d-4d8d-875f-50fd534f66ef]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:01 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 Sep 10 20:15:01 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Flow 'volume_create_manager' (7b8eb304-2b75-4d53-933b-62c5277ba82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a24fda8-0fd5-43fc-bb5c-51ea2bbb2d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a24fda8-0fd5-43fc-bb5c-51ea2bbb2d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1929441450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951158b6-d51f-4b50-9bc7-19caf1f3173e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69a86494dc6485f847801e93c15d561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:15:02Z,use_quota=True,user_id='8073d63f3c4240059abf5e91ff01c430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01353c47-ecdb-48a4-82d6-8c2b5d11b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01353c47-ecdb-48a4-82d6-8c2b5d11b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3ea854-7a69-4cc7-8dc1-92172ac9e45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3ea854-7a69-4cc7-8dc1-92172ac9e45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '951158b6-d51f-4b50-9bc7-19caf1f3173e', 'volume_name': 'volume-951158b6-d51f-4b50-9bc7-19caf1f3173e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bada4f32-a477-4e42-9be1-b09712290a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bada4f32-a477-4e42-9be1-b09712290a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a42c82-0a99-4951-81ce-8cf7ec8d87a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:01 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Volume 951158b6-d51f-4b50-9bc7-19caf1f3173e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-951158b6-d51f-4b50-9bc7-19caf1f3173e', 'volume_size': 1} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1929441450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951158b6-d51f-4b50-9bc7-19caf1f3173e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e69a86494dc6485f847801e93c15d561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:15:02Z,use_quota=True,user_id='8073d63f3c4240059abf5e91ff01c430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Creating volume 951158b6-d51f-4b50-9bc7-19caf1f3173e {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:15:02 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:02 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71" returned: 0 in 0.613s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:02 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e 1073741824 Sep 10 20:15:02 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:02 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71 Sep 10 20:15:02 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:02 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6712bf75-e633-42be-bc8c-6ea1d7275a71" returned: 0 in 0.454s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Lock "cinder-quobyte-6712bf75-e633-42be-bc8c-6ea1d7275a71" released by "delete_volume" :: held 1.152s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Created reservations ['f36a8786-ef65-4814-b03e-b4e55ccb3b3d', 'a2ec4a05-5ce9-4eb3-b2e8-5befbf2dff28', '1918c885-fe94-4f97-9714-0f3ffc8723c3', '6aff4b87-d44d-4a8c-9eb1-f463fcb03a2c'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:15:02 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e 1073741824" returned: 0 in 0.759s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:02 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:15:02 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:02 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e Sep 10 20:15:02 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:03 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.306s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:15:03 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Deleted volume successfully. Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e5e71f4a-b19f-4d8c-8129-333df76f39c1 tempest-VolumesNegativeTest-469301132 None] Lock "cinder-6712bf75-e633-42be-bc8c-6ea1d7275a71-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:03 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e" returned: 0 in 0.319s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a42c82-0a99-4951-81ce-8cf7ec8d87a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951158b6-d51f-4b50-9bc7-19caf1f3173e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3207a589-6c24-403e-b853-a0a33e32d0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:03 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Volume volume-951158b6-d51f-4b50-9bc7-19caf1f3173e (951158b6-d51f-4b50-9bc7-19caf1f3173e): created successfully Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3207a589-6c24-403e-b853-a0a33e32d0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Flow 'volume_create_manager' (7b8eb304-2b75-4d53-933b-62c5277ba82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:15:03 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-903d4a14-1492-43a9-bdab-61c6e67cbfbb tempest-AbsoluteLimitsTests-385667825 None] Created volume successfully. Sep 10 20:15:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Acquiring lock "cinder-951158b6-d51f-4b50-9bc7-19caf1f3173e-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Lock "cinder-951158b6-d51f-4b50-9bc7-19caf1f3173e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Acquiring lock "cinder-quobyte-951158b6-d51f-4b50-9bc7-19caf1f3173e" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Lock "cinder-quobyte-951158b6-d51f-4b50-9bc7-19caf1f3173e" acquired by "delete_volume" :: waited 0.052s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:04 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7432ef9e-b5c8-4bbb-8605-e103bda7506f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:04 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e Sep 10 20:15:04 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:05 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e" returned: 0 in 0.541s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:05 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e Sep 10 20:15:05 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:05 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-951158b6-d51f-4b50-9bc7-19caf1f3173e" returned: 0 in 0.678s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Lock "cinder-quobyte-951158b6-d51f-4b50-9bc7-19caf1f3173e" released by "delete_volume" :: held 1.384s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Created reservations ['91aec730-d85e-4b31-9b54-7241f4b46f16', '54718a30-94fb-4f87-9dd7-0ceb4ab6b2ad', '0ed48b66-65ad-4fea-a195-e22a290a247f', 'd610da1f-1313-4e71-8761-ca2a0e70abcb'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:06 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:15:06 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:06 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.384s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:15:06 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Deleted volume successfully. Sep 10 20:15:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f08ea187-7ea2-478b-9f56-e7e80b02ac1d tempest-AbsoluteLimitsTests-385667825 None] Lock "cinder-951158b6-d51f-4b50-9bc7-19caf1f3173e-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Flow 'volume_create_manager' (77265cd1-9650-4b65-afe3-5954a31a8cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd91fb9b-e3bd-4852-a5a3-fffe2103224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd91fb9b-e3bd-4852-a5a3-fffe2103224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1543736606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065939db-d8f4-472c-abe5-67e1fa43c0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8cb1ae46e64faba56e0c6ba0350325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:15:10Z,use_quota=True,user_id='cf894e4b6b93477e9dae263d063f9157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a2500e-b25c-4861-9947-ccb636355b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a2500e-b25c-4861-9947-ccb636355b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ef7253-9b0d-41e2-ab0c-9c779f860627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ef7253-9b0d-41e2-ab0c-9c779f860627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065939db-d8f4-472c-abe5-67e1fa43c0c5', 'volume_name': 'volume-065939db-d8f4-472c-abe5-67e1fa43c0c5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15967306-f0cb-4955-bcb3-576f285c78c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15967306-f0cb-4955-bcb3-576f285c78c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45009ba7-bba7-497c-9a7f-e042988bb851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:10 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Volume 065939db-d8f4-472c-abe5-67e1fa43c0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065939db-d8f4-472c-abe5-67e1fa43c0c5', 'volume_size': 1} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1543736606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065939db-d8f4-472c-abe5-67e1fa43c0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8cb1ae46e64faba56e0c6ba0350325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:15:10Z,use_quota=True,user_id='cf894e4b6b93477e9dae263d063f9157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Creating volume 065939db-d8f4-472c-abe5-67e1fa43c0c5 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:15:10 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:15:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:10 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 1073741824 Sep 10 20:15:10 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:11 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 1073741824" returned: 0 in 0.922s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:11 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 Sep 10 20:15:11 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:12 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5" returned: 0 in 0.566s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:15:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45009ba7-bba7-497c-9a7f-e042988bb851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065939db-d8f4-472c-abe5-67e1fa43c0c5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10956b18-0c48-4154-8746-03b7bc8d5c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:12 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Volume volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 (065939db-d8f4-472c-abe5-67e1fa43c0c5): created successfully Sep 10 20:15:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10956b18-0c48-4154-8746-03b7bc8d5c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Flow 'volume_create_manager' (77265cd1-9650-4b65-afe3-5954a31a8cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:15:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-69272e0c-ea94-4c91-8037-56d2cb1cbec2 tempest-TestMinimumBasicScenario-471518689 None] Created volume successfully. Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Flow 'volume_create_manager' (379f2d18-0b93-413e-b151-4619d1bcd5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f61150-f719-4978-8093-1b85087d1e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f61150-f719-4978-8093-1b85087d1e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-934415384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5402f5f-1ccb-4af1-a1cf-4e9c63b45321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac7986df3474c79b1d976560a81987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:15:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:15:13Z,use_quota=True,user_id='e3ad333584554883b4da5c7e413793f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061419a4-f830-4cf1-ba51-ac7a9f0f79c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061419a4-f830-4cf1-ba51-ac7a9f0f79c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ab71a0-fc57-4e25-9e7c-793589b877d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ab71a0-fc57-4e25-9e7c-793589b877d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5402f5f-1ccb-4af1-a1cf-4e9c63b45321', 'volume_name': 'volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321', 'volume_size': 2}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20315ae4-1e32-4a16-b156-533b199d4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20315ae4-1e32-4a16-b156-533b199d4967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd83b349-a0e8-4ca4-a080-69ed06ddd47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:13 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Volume a5402f5f-1ccb-4af1-a1cf-4e9c63b45321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321', 'volume_size': 2} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-934415384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5402f5f-1ccb-4af1-a1cf-4e9c63b45321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac7986df3474c79b1d976560a81987b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:15:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:15:13Z,use_quota=True,user_id='e3ad333584554883b4da5c7e413793f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Creating volume a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:15:13 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:15:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 2147483648 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:13 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 2147483648 Sep 10 20:15:13 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:14 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 2147483648" returned: 0 in 0.987s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:14 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 Sep 10 20:15:14 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:15 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" returned: 0 in 0.893s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd83b349-a0e8-4ca4-a080-69ed06ddd47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321', 'volume_size': 2}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ade433f-544e-40c6-b8bc-c73191f0ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:15 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Volume volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 (a5402f5f-1ccb-4af1-a1cf-4e9c63b45321): created successfully Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ade433f-544e-40c6-b8bc-c73191f0ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Flow 'volume_create_manager' (379f2d18-0b93-413e-b151-4619d1bcd5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:15:15 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2bea2293-5297-464c-99c0-fc29cd64c9a9 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Created volume successfully. Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-aaa9662d-f829-462e-a104-127ea2dc959c req-503028c8-bf98-4140-9577-d7ec1e3e8d0e tempest-TestMinimumBasicScenario-471518689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-aaa9662d-f829-462e-a104-127ea2dc959c req-503028c8-bf98-4140-9577-d7ec1e3e8d0e tempest-TestMinimumBasicScenario-471518689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-aaa9662d-f829-462e-a104-127ea2dc959c req-503028c8-bf98-4140-9577-d7ec1e3e8d0e tempest-TestMinimumBasicScenario-471518689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-aaa9662d-f829-462e-a104-127ea2dc959c req-503028c8-bf98-4140-9577-d7ec1e3e8d0e tempest-TestMinimumBasicScenario-471518689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-065939db-d8f4-472c-abe5-67e1fa43c0c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '273e25d0-4016-4d30-a63f-6bb3e676e69e', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:15:16 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-aaa9662d-f829-462e-a104-127ea2dc959c req-503028c8-bf98-4140-9577-d7ec1e3e8d0e tempest-TestMinimumBasicScenario-471518689 None] attachment_update completed successfully. Sep 10 20:15:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Creating offline snapshot a0c46b3a-9e49-41a2-8900-e17df7db4b8b of volume a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:15:17 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd49fa-74a9-45ba-a0ba-05c39e3f5a6f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:17 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 Sep 10 20:15:17 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:18 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" returned: 0 in 1.213s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b 2G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:18 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b 2G Sep 10 20:15:18 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:19 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b 2G" returned: 0 in 1.159s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:19 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b Sep 10 20:15:19 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:20 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b" returned: 0 in 0.546s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:20 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b is being set with open permissions: ugo+rw Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:20 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b Sep 10 20:15:20 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:20 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:15:20 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:20 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b" returned: 0 in 0.689s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:20 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=72,cinder:INSERT=21,cinder:UPDATE=99,cinder:DELETE=9 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.413s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:15:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:21 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.info Sep 10 20:15:21 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:21 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.info" returned: 0 in 0.475s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:21 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.info is being set with open permissions: ugo+rw Sep 10 20:15:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:21 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.info Sep 10 20:15:21 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:21 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.info" returned: 0 in 0.309s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.666s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-045cbca9-3df8-4f1f-b538-e2479f61d261 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Create snapshot completed successfully Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Acquiring lock "cinder-a0c46b3a-9e49-41a2-8900-e17df7db4b8b-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-a0c46b3a-9e49-41a2-8900-e17df7db4b8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Acquiring lock "cinder-quobyte-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-quobyte-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Acquiring lock "cinder-quobyte-a0c46b3a-9e49-41a2-8900-e17df7db4b8b" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-quobyte-a0c46b3a-9e49-41a2-8900-e17df7db4b8b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Deleting offline snapshot a0c46b3a-9e49-41a2-8900-e17df7db4b8b of volume a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] snapshot_file for this snap is: volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9511ae-9a95-4c69-a24b-3ad9479d1543]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:23 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b Sep 10 20:15:23 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:23 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b" returned: 0 in 1.073s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:15:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac243b-14c9-4642-8e95-fdda0ed0446b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:24 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 Sep 10 20:15:24 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:24 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" returned: 0 in 0.704s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:24 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b Sep 10 20:15:24 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:25 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b" returned: 0 in 0.505s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:25 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b Sep 10 20:15:25 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:25 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321.a0c46b3a-9e49-41a2-8900-e17df7db4b8b" returned: 0 in 0.324s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-quobyte-a0c46b3a-9e49-41a2-8900-e17df7db4b8b" released by "_delete_snapshot" :: held 2.776s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-quobyte-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" released by "delete_snapshot" :: held 2.807s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:25 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Created reservations ['07920143-dc5a-47a7-b158-1ab8194b726b', '21341424-d5c0-4ba0-aa73-96ab197d0ae4', '712b7975-560c-4ec4-973e-948e5f55f19e', '1c7bdb24-d9e3-4f40-97f7-fbb1146bcec6'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:15:25 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Delete snapshot completed successfully. Sep 10 20:15:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-16abf15a-9ea6-4c23-bbc9-0509ce7f3185 tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-a0c46b3a-9e49-41a2-8900-e17df7db4b8b-delete_snapshot" released by "delete_snapshot" :: held 3.033s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Flow 'volume_create_manager' (56db0d8c-1e86-49f5-acb3-15242eea0568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e035a44-81ac-4883-b1d6-9441a3a09907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Acquiring lock "cinder-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e035a44-81ac-4883-b1d6-9441a3a09907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1099222313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffeea793-c8da-4cac-acff-1e553daca018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97555a330ac14ff7a40b400f78536023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:15:26Z,use_quota=True,user_id='90ce358b98d1484ba2c78bf341295e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a40f87-b473-4ba3-92f6-9abad6a7e063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a40f87-b473-4ba3-92f6-9abad6a7e063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fea6e8-a5d6-41b5-bd3d-89dc34e4f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fea6e8-a5d6-41b5-bd3d-89dc34e4f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffeea793-c8da-4cac-acff-1e553daca018', 'volume_name': 'volume-ffeea793-c8da-4cac-acff-1e553daca018', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd089a4b-1949-49bc-8a96-bf9be7229826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd089a4b-1949-49bc-8a96-bf9be7229826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b64550-8868-447f-b20f-a34eecd40259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:26 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Volume ffeea793-c8da-4cac-acff-1e553daca018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffeea793-c8da-4cac-acff-1e553daca018', 'volume_size': 1} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1099222313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffeea793-c8da-4cac-acff-1e553daca018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97555a330ac14ff7a40b400f78536023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:15:26Z,use_quota=True,user_id='90ce358b98d1484ba2c78bf341295e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Creating volume ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:15:26 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:26 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 1073741824 Sep 10 20:15:26 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Acquiring lock "cinder-quobyte-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-quobyte-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[722c9258-0cdb-4fce-b9ae-bf8938ea060e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:26 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 Sep 10 20:15:26 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:26 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 1073741824" returned: 0 in 0.521s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:26 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" returned: 0 in 0.432s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:26 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 Sep 10 20:15:26 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:26 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321 Sep 10 20:15:26 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:27 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018" returned: 0 in 0.322s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b64550-8868-447f-b20f-a34eecd40259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffeea793-c8da-4cac-acff-1e553daca018', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87815df0-55f6-4c37-af93-77bb5c9a9e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:15:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Volume volume-ffeea793-c8da-4cac-acff-1e553daca018 (ffeea793-c8da-4cac-acff-1e553daca018): created successfully Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87815df0-55f6-4c37-af93-77bb5c9a9e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Flow 'volume_create_manager' (56db0d8c-1e86-49f5-acb3-15242eea0568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:15:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ed762c5c-b3cf-4e41-beb5-c341efb3902c tempest-VolumesSnapshotListTestJSON-575850941 None] Created volume successfully. Sep 10 20:15:27 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" returned: 0 in 0.404s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-quobyte-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321" released by "delete_volume" :: held 0.916s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Created reservations ['71658a38-a26d-4a27-84a6-516fe813c76e', '31b1ce96-4886-4671-b247-89e9cb80e54f', '65f104bb-e705-4457-bbdd-85c86a22f346', 'f512c73d-cd21-4ed1-be71-01551cab25e8'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:27 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:15:27 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:27 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.436s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:15:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Deleted volume successfully. Sep 10 20:15:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d1275234-3bb5-49e3-b174-0dc079f6613b tempest-VolumesSnapshotNegativeTestJSON-864825584 None] Lock "cinder-a5402f5f-1ccb-4af1-a1cf-4e9c63b45321-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Creating offline snapshot 2abffc2d-c3fd-4b1a-9c06-271e983474d8 of volume ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:15:28 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6407285e-2235-4b42-aebf-0644cacbede8]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:28 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 Sep 10 20:15:28 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:28 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018" returned: 0 in 0.403s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:28 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 1G Sep 10 20:15:28 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:29 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 1G" returned: 0 in 0.474s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffeea793-c8da-4cac-acff-1e553daca018 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:29 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffeea793-c8da-4cac-acff-1e553daca018 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 Sep 10 20:15:29 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:29 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffeea793-c8da-4cac-acff-1e553daca018 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8" returned: 0 in 0.357s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:29 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 is being set with open permissions: ugo+rw Sep 10 20:15:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:29 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 Sep 10 20:15:29 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:30 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8" returned: 0 in 0.287s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:30 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.info Sep 10 20:15:30 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:30 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.info" returned: 0 in 0.289s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:30 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.info is being set with open permissions: ugo+rw Sep 10 20:15:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:30 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.info Sep 10 20:15:30 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:30 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.info" returned: 0 in 0.332s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-acf06da9-e466-4594-9c98-99f97cc3cbe8 tempest-VolumesSnapshotListTestJSON-575850941 None] Create snapshot completed successfully Sep 10 20:15:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Creating offline snapshot 13d825cc-d9ba-4dda-985f-549099f291dd of volume ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:15:31 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90c3733-f526-4c78-8021-f8a38fefaac4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:31 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 Sep 10 20:15:31 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:32 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8" returned: 0 in 0.444s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffeea793-c8da-4cac-acff-1e553daca018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:15:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:32 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd 1G Sep 10 20:15:32 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:32 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd 1G" returned: 0 in 0.548s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:32 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd Sep 10 20:15:32 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:33 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd" returned: 0 in 0.339s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:33 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd is being set with open permissions: ugo+rw Sep 10 20:15:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:33 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd Sep 10 20:15:33 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:33 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd" returned: 0 in 0.292s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.745s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a0495ca2-dd7c-47f3-a74d-de92210b1331 tempest-VolumesSnapshotListTestJSON-575850941 None] Create snapshot completed successfully Sep 10 20:15:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Creating offline snapshot 76b9b5a0-b044-4537-ba40-a024477ee282 of volume ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:15:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e225c6c-797f-4098-9831-02782eb8f0e4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:34 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd Sep 10 20:15:34 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:34 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd" returned: 0 in 0.419s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffeea793-c8da-4cac-acff-1e553daca018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:15:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:34 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 1G Sep 10 20:15:34 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:35 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 1G" returned: 0 in 0.774s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:35 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 Sep 10 20:15:35 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:35 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282" returned: 0 in 0.416s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:35 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 is being set with open permissions: ugo+rw Sep 10 20:15:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:35 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 Sep 10 20:15:35 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:36 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282" returned: 0 in 0.547s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.305s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-55cc2b40-5fca-4e45-bdcf-d01054a1451d tempest-VolumesSnapshotListTestJSON-575850941 None] Create snapshot completed successfully Sep 10 20:15:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-76b9b5a0-b044-4537-ba40-a024477ee282-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-76b9b5a0-b044-4537-ba40-a024477ee282-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-quobyte-76b9b5a0-b044-4537-ba40-a024477ee282" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-76b9b5a0-b044-4537-ba40-a024477ee282" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Deleting offline snapshot 76b9b5a0-b044-4537-ba40-a024477ee282 of volume ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:15:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] snapshot_file for this snap is: volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:15:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[40236537-98ef-4bec-a404-1937bcba6721]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:39 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 Sep 10 20:15:39 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:39 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282" returned: 0 in 0.784s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffeea793-c8da-4cac-acff-1e553daca018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:15:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9ac39-cc97-44fa-a0ab-bc82fe2f5256]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:40 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd Sep 10 20:15:40 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:40 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd" returned: 0 in 0.718s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffeea793-c8da-4cac-acff-1e553daca018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:15:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:40 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 Sep 10 20:15:40 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:41 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282" returned: 0 in 0.637s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:41 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282 Sep 10 20:15:41 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:41 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.76b9b5a0-b044-4537-ba40-a024477ee282" returned: 0 in 0.431s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-76b9b5a0-b044-4537-ba40-a024477ee282" released by "_delete_snapshot" :: held 2.787s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" released by "delete_snapshot" :: held 2.844s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Created reservations ['3236d657-2366-4849-b9c6-c0e64808c01e', '5ab636ec-2ce0-4184-8d1b-24078f1c2887', 'f7848222-3517-4c8c-ba7e-7f1e0302306e', 'd5699d82-aba4-4e43-9a20-6b97e4150dd0'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:15:42 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Delete snapshot completed successfully. Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-13d825cc-d9ba-4dda-985f-549099f291dd-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2b2adcf7-a4c0-48d9-85f7-e95d862998dc tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-76b9b5a0-b044-4537-ba40-a024477ee282-delete_snapshot" released by "delete_snapshot" :: held 3.315s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-13d825cc-d9ba-4dda-985f-549099f291dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-quobyte-13d825cc-d9ba-4dda-985f-549099f291dd" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-13d825cc-d9ba-4dda-985f-549099f291dd" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Deleting offline snapshot 13d825cc-d9ba-4dda-985f-549099f291dd of volume ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] snapshot_file for this snap is: volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7803284c-5c6a-44c6-93eb-410eb2639b1c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:42 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd Sep 10 20:15:42 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:43 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd" returned: 0 in 0.496s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffeea793-c8da-4cac-acff-1e553daca018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:15:43 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbd2601-4522-4bc0-ab65-4e159299d2af]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:43 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 Sep 10 20:15:43 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:43 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8" returned: 0 in 0.493s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffeea793-c8da-4cac-acff-1e553daca018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:15:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:43 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd Sep 10 20:15:43 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:44 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd" returned: 0 in 0.615s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:44 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd Sep 10 20:15:44 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:44 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.13d825cc-d9ba-4dda-985f-549099f291dd" returned: 0 in 0.489s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-13d825cc-d9ba-4dda-985f-549099f291dd" released by "_delete_snapshot" :: held 2.253s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" released by "delete_snapshot" :: held 2.295s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:44 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Created reservations ['3c30e694-e05b-4c14-b30d-7cdb6b197456', '667eedd9-d88d-4f1d-b6bc-3cf89297a8e6', 'c426fd3b-90d4-4ef0-8fc3-bfe96a26aef3', 'a775cdeb-f84f-4aff-85b8-398ea8bd55a7'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:15:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Delete snapshot completed successfully. Sep 10 20:15:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0ed6c91b-3197-4cc9-a534-0fbfb1678974 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-13d825cc-d9ba-4dda-985f-549099f291dd-delete_snapshot" released by "delete_snapshot" :: held 2.540s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-2abffc2d-c3fd-4b1a-9c06-271e983474d8-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-2abffc2d-c3fd-4b1a-9c06-271e983474d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-quobyte-2abffc2d-c3fd-4b1a-9c06-271e983474d8" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-2abffc2d-c3fd-4b1a-9c06-271e983474d8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Deleting offline snapshot 2abffc2d-c3fd-4b1a-9c06-271e983474d8 of volume ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] snapshot_file for this snap is: volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[356c71df-893f-4278-a2bc-89b3e7ce2d50]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:45 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-0ba86e47-975a-48a3-b078-b9f610a6f1d6 req-4b612691-13ed-4d54-8486-849f26bc5b0a tempest-AttachVolumeNegativeTest-2145474300 None] Terminate volume connection completed successfully. Sep 10 20:15:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-0ba86e47-975a-48a3-b078-b9f610a6f1d6 req-4b612691-13ed-4d54-8486-849f26bc5b0a tempest-AttachVolumeNegativeTest-2145474300 None] Deleting attachment 6526c724-ba90-4896-baa7-f49685c3e2a3. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:15:46 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 Sep 10 20:15:46 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:46 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8" returned: 0 in 0.610s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffeea793-c8da-4cac-acff-1e553daca018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:15:46 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946d6d6-149d-4183-9fd3-2a244ee39b40]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:46 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 Sep 10 20:15:46 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:47 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018" returned: 0 in 1.046s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:47 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 Sep 10 20:15:47 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:48 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8" returned: 0 in 0.657s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:48 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8 Sep 10 20:15:48 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:48 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018.2abffc2d-c3fd-4b1a-9c06-271e983474d8" returned: 0 in 0.443s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-2abffc2d-c3fd-4b1a-9c06-271e983474d8" released by "_delete_snapshot" :: held 2.893s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" released by "delete_snapshot" :: held 2.926s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:48 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Created reservations ['a2d5f6e2-add3-43ea-acf7-4f5c3172b011', '46615147-fbd3-458e-88c7-1d7f79ba20d2', '6a098d6c-e81d-416e-851b-494937e98e19', '6336a292-9288-417d-9c11-d29b8aa1d143'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:15:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Delete snapshot completed successfully. Sep 10 20:15:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2f5a6a1-4e46-4f11-ae9b-9180ee4e52af tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-2abffc2d-c3fd-4b1a-9c06-271e983474d8-delete_snapshot" released by "delete_snapshot" :: held 3.206s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-ffeea793-c8da-4cac-acff-1e553daca018-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-ffeea793-c8da-4cac-acff-1e553daca018-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19cff0c-3250-4801-a693-9f8078ad6513]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:50 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 Sep 10 20:15:50 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:50 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018" returned: 0 in 0.446s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:50 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018 Sep 10 20:15:50 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:50 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ffeea793-c8da-4cac-acff-1e553daca018" returned: 0 in 0.322s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-quobyte-ffeea793-c8da-4cac-acff-1e553daca018" released by "delete_volume" :: held 0.855s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Created reservations ['3d32963f-e962-4d39-9dc1-40d08a4b4d58', '3b2d08fe-c9bc-49d2-ba7f-d7b9d3931d9d', 'b3c0350c-631c-45a4-9958-8ffec3920f19', '122413a0-af3b-4436-8b05-1a9a4facb617'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:15:51 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:15:51 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:15:51 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.324s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:15:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Deleted volume successfully. Sep 10 20:15:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-71eb39b7-b08d-4647-9866-0595ec957cf5 tempest-VolumesSnapshotListTestJSON-575850941 None] Lock "cinder-ffeea793-c8da-4cac-acff-1e553daca018-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:16:01 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=70,cinder:SELECT=70,cinder:INSERT=19,cinder:DELETE=4 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:16:01 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=43,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=6 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Flow 'volume_create_manager' (14e55a4b-2267-4fa6-9cf3-e5262e16a5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7896fc-fdab-4b66-86e3-8efab2860838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7896fc-fdab-4b66-86e3-8efab2860838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-484477615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7629d4c-3547-4c3e-afb3-e9fc45231d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2059146e1f04e8192f10fcf2c188b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:03Z,use_quota=True,user_id='21d9d90b18b34804a64c255bac6c02eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ed6b97b-af68-4a14-8c74-f06313cefe5b),volume_type_id=8ed6b97b-af68-4a14-8c74-f06313cefe5b)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ca3bd9-f2aa-4cfd-843a-93ed66c104bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ca3bd9-f2aa-4cfd-843a-93ed66c104bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8751de37-1960-4d04-8e48-f5e7772a3b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8751de37-1960-4d04-8e48-f5e7772a3b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7629d4c-3547-4c3e-afb3-e9fc45231d54', 'volume_name': 'volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8316c8fc-ede3-4f73-8b2d-e6d3b5834160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8316c8fc-ede3-4f73-8b2d-e6d3b5834160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bbac8a-e4e7-4571-8b07-fc0ca371ebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:02 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Volume f7629d4c-3547-4c3e-afb3-e9fc45231d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54', 'volume_size': 1} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-484477615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7629d4c-3547-4c3e-afb3-e9fc45231d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2059146e1f04e8192f10fcf2c188b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:03Z,use_quota=True,user_id='21d9d90b18b34804a64c255bac6c02eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ed6b97b-af68-4a14-8c74-f06313cefe5b),volume_type_id=8ed6b97b-af68-4a14-8c74-f06313cefe5b)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Creating volume f7629d4c-3547-4c3e-afb3-e9fc45231d54 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:16:02 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:16:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:02 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 1073741824 Sep 10 20:16:02 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:03 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 1073741824" returned: 0 in 0.777s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:03 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-24a284b4-e493-46c5-97f8-0e346520fb82 req-ead60474-e824-4555-9bfc-0b7066799e67 tempest-TestMinimumBasicScenario-471518689 None] Terminate volume connection completed successfully. Sep 10 20:16:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-24a284b4-e493-46c5-97f8-0e346520fb82 req-ead60474-e824-4555-9bfc-0b7066799e67 tempest-TestMinimumBasicScenario-471518689 None] Deleting attachment 273e25d0-4016-4d30-a63f-6bb3e676e69e. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:16:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:03 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 Sep 10 20:16:03 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:03 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:16:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Flow 'volume_create_manager' (29d62145-8091-4d93-9344-6371c7d2c21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d02393-273a-426a-8910-a066c8aecd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d02393-273a-426a-8910-a066c8aecd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-7748860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e666e3-30aa-44fb-9326-517c8f523d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2059146e1f04e8192f10fcf2c188b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:04Z,use_quota=True,user_id='21d9d90b18b34804a64c255bac6c02eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(993fad7f-7448-4073-a0c0-fbd1ed9e414f),volume_type_id=993fad7f-7448-4073-a0c0-fbd1ed9e414f)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f95929-3491-4f05-8cd8-aaf167843392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f95929-3491-4f05-8cd8-aaf167843392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5a7c2e-e967-4621-a815-324920ce20f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5a7c2e-e967-4621-a815-324920ce20f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e666e3-30aa-44fb-9326-517c8f523d44', 'volume_name': 'volume-b0e666e3-30aa-44fb-9326-517c8f523d44', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d400620-850b-445c-ab0f-8ffbd412657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d400620-850b-445c-ab0f-8ffbd412657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6871ce90-cb6b-4fcb-92c0-bbfe555b7690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:04 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Volume b0e666e3-30aa-44fb-9326-517c8f523d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e666e3-30aa-44fb-9326-517c8f523d44', 'volume_size': 1} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:04 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54" returned: 0 in 0.461s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.053s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-7748860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e666e3-30aa-44fb-9326-517c8f523d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2059146e1f04e8192f10fcf2c188b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:04Z,use_quota=True,user_id='21d9d90b18b34804a64c255bac6c02eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(993fad7f-7448-4073-a0c0-fbd1ed9e414f),volume_type_id=993fad7f-7448-4073-a0c0-fbd1ed9e414f)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Creating volume b0e666e3-30aa-44fb-9326-517c8f523d44 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:16:04 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bbac8a-e4e7-4571-8b07-fc0ca371ebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed7fd52-201f-4f74-a498-7bc983c568fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:04 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44 1073741824 Sep 10 20:16:04 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:04 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Volume volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 (f7629d4c-3547-4c3e-afb3-e9fc45231d54): created successfully Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed7fd52-201f-4f74-a498-7bc983c568fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Flow 'volume_create_manager' (14e55a4b-2267-4fa6-9cf3-e5262e16a5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:04 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0e10f9f2-c677-49ab-aba7-4c79d77b664c tempest-TestInstancesWithCinderVolumes-1561640475 None] Created volume successfully. Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Acquiring lock "cinder-065939db-d8f4-472c-abe5-67e1fa43c0c5-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Lock "cinder-065939db-d8f4-472c-abe5-67e1fa43c0c5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Acquiring lock "cinder-quobyte-065939db-d8f4-472c-abe5-67e1fa43c0c5" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Lock "cinder-quobyte-065939db-d8f4-472c-abe5-67e1fa43c0c5" acquired by "delete_volume" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[701a4ceb-0c88-4cea-bfef-33c11ef6bfd0]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Flow 'volume_create_manager' (5f289062-15e5-4ba8-9753-f1162fe6d51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a4d7ec-4d80-464d-ab2f-2eb1ee86eb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:05 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 Sep 10 20:16:05 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:05 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a4d7ec-4d80-464d-ab2f-2eb1ee86eb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1429156840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13cf803-a258-47e5-9a4f-335b5e2be249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2059146e1f04e8192f10fcf2c188b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:05Z,use_quota=True,user_id='21d9d90b18b34804a64c255bac6c02eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47f91ef6-f247-46b2-9d19-7a225bd0926b),volume_type_id=47f91ef6-f247-46b2-9d19-7a225bd0926b)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfb89e0-0179-4a72-9cb0-eccfb2d00726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfb89e0-0179-4a72-9cb0-eccfb2d00726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462f7d26-2aa8-4276-b3cd-f3ebd9ea31a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44 1073741824" returned: 0 in 0.950s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:05 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44 Sep 10 20:16:05 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:05 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5" returned: 0 in 0.580s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:05 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5 Sep 10 20:16:05 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462f7d26-2aa8-4276-b3cd-f3ebd9ea31a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b13cf803-a258-47e5-9a4f-335b5e2be249', 'volume_name': 'volume-b13cf803-a258-47e5-9a4f-335b5e2be249', 'volume_size': 1, 'image_id': '5ad91538-2881-4af1-8935-8dc4b1468f39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ad91538-2881-4af1-8935-8dc4b1468f39', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1434723022', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd2059146e1f04e8192f10fcf2c188b92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ad91538-2881-4af1-8935-8dc4b1468f39', 'created_at': datetime.datetime(2026, 9, 10, 18, 15, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 16, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ad91538-2881-4af1-8935-8dc4b1468f39/file', 'properties': {}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932830e7-27e3-40fa-b965-3391a40a9fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932830e7-27e3-40fa-b965-3391a40a9fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50d4e10-7add-4c64-a197-d86a1fb64e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:05 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Volume b13cf803-a258-47e5-9a4f-335b5e2be249: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b13cf803-a258-47e5-9a4f-335b5e2be249', 'volume_size': 1, 'image_id': '5ad91538-2881-4af1-8935-8dc4b1468f39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ad91538-2881-4af1-8935-8dc4b1468f39', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1434723022', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd2059146e1f04e8192f10fcf2c188b92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ad91538-2881-4af1-8935-8dc4b1468f39', 'created_at': datetime.datetime(2026, 9, 10, 18, 15, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 16, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ad91538-2881-4af1-8935-8dc4b1468f39/file', 'properties': {}}, 'image_service': } Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Trying to clone b13cf803-a258-47e5-9a4f-335b5e2be249 from image 5ad91538-2881-4af1-8935-8dc4b1468f39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ad91538-2881-4af1-8935-8dc4b1468f39', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:16:05 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44" returned: 0 in 0.457s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6871ce90-cb6b-4fcb-92c0-bbfe555b7690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e666e3-30aa-44fb-9326-517c8f523d44', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce1e3db-9d44-4214-afd1-2fd96663a06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:05 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Volume volume-b0e666e3-30aa-44fb-9326-517c8f523d44 (b0e666e3-30aa-44fb-9326-517c8f523d44): created successfully Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce1e3db-9d44-4214-afd1-2fd96663a06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:05 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Flow 'volume_create_manager' (29d62145-8091-4d93-9344-6371c7d2c21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-065939db-d8f4-472c-abe5-67e1fa43c0c5" returned: 0 in 0.451s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Lock "cinder-quobyte-065939db-d8f4-472c-abe5-67e1fa43c0c5" released by "delete_volume" :: held 1.114s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:16:06 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6e13d878-0389-4b3f-9c9e-24bf15bd51a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Created volume successfully. Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Created reservations ['c1a24997-3528-427d-837c-00a04bd32249', '26c4b3f7-753c-420d-b8d2-370215f48c0c', 'f9577860-f206-47b3-a299-9f14011bdc8d', 'a7927acc-02bc-435e-bf57-ec6df0466f54'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:06 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:16:06 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:06 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.390s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:16:06 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Deleted volume successfully. Sep 10 20:16:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-12097b82-a2a7-436f-8205-f6560d0fb049 tempest-TestMinimumBasicScenario-471518689 None] Lock "cinder-065939db-d8f4-472c-abe5-67e1fa43c0c5-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:16:10 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD, size 20.69 MB, duration 4.98 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:16:10 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Image download 20.69 MB at 4.15 MB/s Sep 10 20:16:10 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0cae87-0b1f-4751-a208-f0e9a87f032d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:10 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD Sep 10 20:16:10 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:11 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Temporary image 5ad91538-2881-4af1-8935-8dc4b1468f39 is fetched for user 21d9d90b18b34804a64c255bac6c02eb. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc975c0-af82-465e-8531-093bf66fb3d5]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:11 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD Sep 10 20:16:11 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:11 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1429156840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13cf803-a258-47e5-9a4f-335b5e2be249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2059146e1f04e8192f10fcf2c188b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:05Z,use_quota=True,user_id='21d9d90b18b34804a64c255bac6c02eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47f91ef6-f247-46b2-9d19-7a225bd0926b),volume_type_id=47f91ef6-f247-46b2-9d19-7a225bd0926b)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Creating volume b13cf803-a258-47e5-9a4f-335b5e2be249 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:16:11 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:16:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:11 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 1073741824 Sep 10 20:16:11 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:12 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 1073741824" returned: 0 in 0.708s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:12 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 Sep 10 20:16:12 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:12 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249" returned: 0 in 0.439s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:16:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:12 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Attempting download of 5ad91538-2881-4af1-8935-8dc4b1468f39 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ad91538-2881-4af1-8935-8dc4b1468f39', 'metadata': {}}])) to volume b13cf803-a258-47e5-9a4f-335b5e2be249. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:16:12 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef55daf7-12a0-4712-9d47-33d8aba9e8d4]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ad91538-2881-4af1-8935-8dc4b1468f39_qbcxg6c3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:13 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ad91538-2881-4af1-8935-8dc4b1468f39_qbcxg6c3 Sep 10 20:16:13 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:13 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ad91538-2881-4af1-8935-8dc4b1468f39_qbcxg6c3" returned: 0 in 0.790s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad91538-2881-4af1-8935-8dc4b1468f39_qbcxg6c3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:13 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad91538-2881-4af1-8935-8dc4b1468f39_qbcxg6c3 Sep 10 20:16:13 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:14 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad91538-2881-4af1-8935-8dc4b1468f39_qbcxg6c3" returned: 1 in 0.683s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad91538-2881-4af1-8935-8dc4b1468f39_qbcxg6c3' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:16:14 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc576ff-9b86-4692-8470-49214ae9187b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:14 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD Sep 10 20:16:14 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:14 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:14 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] 5ad91538-2881-4af1-8935-8dc4b1468f39 was qcow2, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:16:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:14 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 Sep 10 20:16:14 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:17 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249" returned: 0 in 3.099s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:17 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ad91538-2881-4af1-8935-8dc4b1468f39_yriu3qfkdevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:16:17 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Converted 112.00 MB image at 36.12 MB/s Sep 10 20:16:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:18 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 1G Sep 10 20:16:18 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:18 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 1G" returned: 0 in 0.526s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Downloaded image 5ad91538-2881-4af1-8935-8dc4b1468f39 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ad91538-2881-4af1-8935-8dc4b1468f39', 'metadata': {}}])) to volume b13cf803-a258-47e5-9a4f-335b5e2be249 successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Temporary image 5ad91538-2881-4af1-8935-8dc4b1468f39 for user 21d9d90b18b34804a64c255bac6c02eb is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Marking volume b13cf803-a258-47e5-9a4f-335b5e2be249 as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Copying metadata from image 5ad91538-2881-4af1-8935-8dc4b1468f39 to b13cf803-a258-47e5-9a4f-335b5e2be249. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Creating volume glance metadata for volume b13cf803-a258-47e5-9a4f-335b5e2be249 backed by image 5ad91538-2881-4af1-8935-8dc4b1468f39 with: {'image_id': '5ad91538-2881-4af1-8935-8dc4b1468f39', 'image_name': 'tempest-scenario-img--1434723022', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50d4e10-7add-4c64-a197-d86a1fb64e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13cf803-a258-47e5-9a4f-335b5e2be249', 'volume_size': 1, 'image_id': '5ad91538-2881-4af1-8935-8dc4b1468f39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ad91538-2881-4af1-8935-8dc4b1468f39', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1434723022', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd2059146e1f04e8192f10fcf2c188b92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ad91538-2881-4af1-8935-8dc4b1468f39', 'created_at': datetime.datetime(2026, 9, 10, 18, 15, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 16, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ad91538-2881-4af1-8935-8dc4b1468f39/file', 'properties': {}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace57e54-32e9-4601-846f-9bba2d633c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:18 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Volume volume-b13cf803-a258-47e5-9a4f-335b5e2be249 (b13cf803-a258-47e5-9a4f-335b5e2be249): created successfully Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace57e54-32e9-4601-846f-9bba2d633c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Flow 'volume_create_manager' (5f289062-15e5-4ba8-9753-f1162fe6d51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-08e14600-7314-424c-9e3d-1c5e9c775191 tempest-TestInstancesWithCinderVolumes-1561640475 None] Created volume successfully. Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:20 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:16:20 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:20 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.312s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:16:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:16:28 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=18,cinder:UPDATE=19,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:16:28 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=8 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:16:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-f045d6a0-aca6-43ef-b064-0971bca1fa32 req-59f2f957-6045-4eee-8b2d-82869f1009ad tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-f045d6a0-aca6-43ef-b064-0971bca1fa32 req-59f2f957-6045-4eee-8b2d-82869f1009ad tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-f045d6a0-aca6-43ef-b064-0971bca1fa32 req-59f2f957-6045-4eee-8b2d-82869f1009ad tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-f045d6a0-aca6-43ef-b064-0971bca1fa32 req-59f2f957-6045-4eee-8b2d-82869f1009ad tempest-TestInstancesWithCinderVolumes-1561640475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-b13cf803-a258-47e5-9a4f-335b5e2be249', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9df4f1f8-ff99-41fe-ad12-69d09c3221dd', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:16:29 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-f045d6a0-aca6-43ef-b064-0971bca1fa32 req-59f2f957-6045-4eee-8b2d-82869f1009ad tempest-TestInstancesWithCinderVolumes-1561640475 None] attachment_update completed successfully. Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Flow 'volume_create_manager' (82ef1bbe-d3ba-45ee-9484-92b34e98ab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f74b2f-5ff9-4db5-b490-c1570c0312b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f74b2f-5ff9-4db5-b490-c1570c0312b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-147291664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecff2228-8144-440b-aa75-0e763848067a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80ed5426eda45ac9fef5e0b8ab16503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:32Z,use_quota=True,user_id='e24ce87a26a34ab1973d6631dae2fb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8309ac13-ff40-496b-ad6a-39ddf9fbf477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8309ac13-ff40-496b-ad6a-39ddf9fbf477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2b7387-7e57-4d7d-be8c-46e964973ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2b7387-7e57-4d7d-be8c-46e964973ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecff2228-8144-440b-aa75-0e763848067a', 'volume_name': 'volume-ecff2228-8144-440b-aa75-0e763848067a', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19513e97-0c39-44a7-85f5-e24593f449f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19513e97-0c39-44a7-85f5-e24593f449f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d7a218-af50-46a2-8837-4d0cb032ca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Volume ecff2228-8144-440b-aa75-0e763848067a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecff2228-8144-440b-aa75-0e763848067a', 'volume_size': 1} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-147291664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecff2228-8144-440b-aa75-0e763848067a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80ed5426eda45ac9fef5e0b8ab16503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:32Z,use_quota=True,user_id='e24ce87a26a34ab1973d6631dae2fb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Creating volume ecff2228-8144-440b-aa75-0e763848067a {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:16:32 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:32 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a 1073741824 Sep 10 20:16:32 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:32 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a 1073741824" returned: 0 in 0.582s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:32 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a Sep 10 20:16:32 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:33 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a" returned: 0 in 0.296s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:16:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:16:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d7a218-af50-46a2-8837-4d0cb032ca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecff2228-8144-440b-aa75-0e763848067a', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43602322-61fa-452f-99dc-01b11da8dee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Volume volume-ecff2228-8144-440b-aa75-0e763848067a (ecff2228-8144-440b-aa75-0e763848067a): created successfully Sep 10 20:16:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43602322-61fa-452f-99dc-01b11da8dee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Flow 'volume_create_manager' (82ef1bbe-d3ba-45ee-9484-92b34e98ab0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-405e2f48-d87d-4019-912c-fd4e8d135c3b tempest-TestImageHashVerification-1393494477 None] Created volume successfully. Sep 10 20:16:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:16:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[43744a50-3668-480a-8177-b665b969bb6b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:36 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a Sep 10 20:16:36 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:36 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a" returned: 0 in 0.509s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aab79d2-11e3-4bf2-90ec-1c42c532d997]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:37 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a Sep 10 20:16:37 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:37 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a" returned: 0 in 0.710s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a /opt/stack/data/cinder/conversion/ecff2228-8144-440b-aa75-0e763848067a.temp_image.f0524d95-a64e-4fe3-b1f1-5ea0b4ba7e9dji62zggv.img {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:37 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a /opt/stack/data/cinder/conversion/ecff2228-8144-440b-aa75-0e763848067a.temp_image.f0524d95-a64e-4fe3-b1f1-5ea0b4ba7e9dji62zggv.img Sep 10 20:16:37 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:43 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Flow 'volume_create_manager' (b1eebd57-2a22-46e5-8485-93c6b5106234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1feb97e3-5582-4bc8-8b49-b112fd867848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1feb97e3-5582-4bc8-8b49-b112fd867848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1973362378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8a281b-3c8b-464b-8072-3d8e5ed02b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148e0b0dc5834fabbbc5714fa21ea6c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:44Z,use_quota=True,user_id='c9bf78f4ac0e441684eb139d09337974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d50a1f-995f-4506-aae7-2153412be960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d50a1f-995f-4506-aae7-2153412be960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138acf94-942f-4b5f-a65b-c033c63ce46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138acf94-942f-4b5f-a65b-c033c63ce46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8a281b-3c8b-464b-8072-3d8e5ed02b40', 'volume_name': 'volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a51bf8-3616-4a24-90cc-f6688dcf993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a51bf8-3616-4a24-90cc-f6688dcf993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be347340-05e9-4e4a-9ff5-eb94601d519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:44 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Volume 1b8a281b-3c8b-464b-8072-3d8e5ed02b40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40', 'volume_size': 1} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:44 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a /opt/stack/data/cinder/conversion/ecff2228-8144-440b-aa75-0e763848067a.temp_image.f0524d95-a64e-4fe3-b1f1-5ea0b4ba7e9dji62zggv.img" returned: 0 in 6.847s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[779997e0-b1e9-42f1-a2e8-bd9819b2be98]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:44 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a Sep 10 20:16:44 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Flow 'volume_create_manager' (eb9acd36-be98-4c6e-a2b4-3a2deb5bc656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8427323f-afce-47a6-89da-1feb2d163ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8427323f-afce-47a6-89da-1feb2d163ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ddc9f7-180c-45a2-bd35-aa4e88aa3757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b56d7dfb0c4c48b58d860aa5aab529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:45Z,use_quota=True,user_id='92886bcea30e4447b4adfb2047e79031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a8ef719-5820-4533-922b-79aef2f14d97),volume_type_id=9a8ef719-5820-4533-922b-79aef2f14d97)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77369d3-bc72-4d5f-adfe-3954618e45e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77369d3-bc72-4d5f-adfe-3954618e45e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c047b1bf-eb2b-4022-9dce-3d9ba4018a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:16:45 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a" returned: 0 in 0.703s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/conversion/ecff2228-8144-440b-aa75-0e763848067a.temp_image.f0524d95-a64e-4fe3-b1f1-5ea0b4ba7e9dji62zggv.img {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:16:45 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Converted 1024.00 MB image at 149.53 MB/s Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] f0524d95-a64e-4fe3-b1f1-5ea0b4ba7e9d was raw, no need to convert to raw {{(pid=88137) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c047b1bf-eb2b-4022-9dce-3d9ba4018a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00ddc9f7-180c-45a2-bd35-aa4e88aa3757', 'volume_name': 'volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757', 'volume_size': 1, 'image_id': 'c218b189-9c4b-4bfd-845c-d69859c25477', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c218b189-9c4b-4bfd-845c-d69859c25477', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16f4c5dd8f25ba787ad8817c3af25213', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38b56d7dfb0c4c48b58d860aa5aab529', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c3fcb69cc11457c121590a96d540cdc36959f7f643ec42b37d3ef61022e70db36ad96dedd16d6169dcaef1cf4bae913841610a0c4e0b99404af111aa554ca11', 'id': 'c218b189-9c4b-4bfd-845c-d69859c25477', 'created_at': datetime.datetime(2026, 9, 10, 18, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 16, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c218b189-9c4b-4bfd-845c-d69859c25477/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e53d743-02a7-43eb-89b2-29bf7f688558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e53d743-02a7-43eb-89b2-29bf7f688558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c186c6f-3b55-4e64-9a4f-1f0d2a49f7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:16:45 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Volume 00ddc9f7-180c-45a2-bd35-aa4e88aa3757: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757', 'volume_size': 1, 'image_id': 'c218b189-9c4b-4bfd-845c-d69859c25477', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c218b189-9c4b-4bfd-845c-d69859c25477', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16f4c5dd8f25ba787ad8817c3af25213', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38b56d7dfb0c4c48b58d860aa5aab529', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c3fcb69cc11457c121590a96d540cdc36959f7f643ec42b37d3ef61022e70db36ad96dedd16d6169dcaef1cf4bae913841610a0c4e0b99404af111aa554ca11', 'id': 'c218b189-9c4b-4bfd-845c-d69859c25477', 'created_at': datetime.datetime(2026, 9, 10, 18, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 16, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c218b189-9c4b-4bfd-845c-d69859c25477/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Trying to clone 00ddc9f7-180c-45a2-bd35-aa4e88aa3757 from image c218b189-9c4b-4bfd-845c-d69859c25477 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c218b189-9c4b-4bfd-845c-d69859c25477', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:16:45 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Image download 0.00 MB at 0.00 MB/s Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9aae4-fc8b-4322-8f55-08f6eab4f317]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:46 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD Sep 10 20:16:46 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:46 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:46 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD Sep 10 20:16:46 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:47 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:16:47 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Temporary image c218b189-9c4b-4bfd-845c-d69859c25477 is fetched for user 92886bcea30e4447b4adfb2047e79031. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:16:47 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[162d9092-5275-4c3b-95ce-e4aef1a725f3]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:16:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:47 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD Sep 10 20:16:47 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:47 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:16:47 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD Sep 10 20:16:47 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:16:48 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 10 20:16:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD" returned: 1 in 0.483s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:16:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:16:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:16:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:16:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:17:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-6d3e0ff7-3208-4177-9cf9-eb2c9d72c924 req-d88ac310-ea70-480a-92a7-7390bebcdb56 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Uploaded volume to glance image-id: f0524d95-a64e-4fe3-b1f1-5ea0b4ba7e9d. {{(pid=88137) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.966s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1973362378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8a281b-3c8b-464b-8072-3d8e5ed02b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148e0b0dc5834fabbbc5714fa21ea6c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:44Z,use_quota=True,user_id='c9bf78f4ac0e441684eb139d09337974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Creating volume 1b8a281b-3c8b-464b-8072-3d8e5ed02b40 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:07 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:07 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 1073741824 Sep 10 20:17:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b716674e-8e80-4d11-9421-49825eb337f1 tempest-TestImageHashVerification-1393494477 None] Copy volume to image completed successfully. Sep 10 20:17:07 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:07 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 1073741824" returned: 0 in 0.430s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:07 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 Sep 10 20:17:07 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:08 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40" returned: 0 in 0.248s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.052s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ddc9f7-180c-45a2-bd35-aa4e88aa3757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b56d7dfb0c4c48b58d860aa5aab529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:16:45Z,use_quota=True,user_id='92886bcea30e4447b4adfb2047e79031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a8ef719-5820-4533-922b-79aef2f14d97),volume_type_id=9a8ef719-5820-4533-922b-79aef2f14d97)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Creating volume 00ddc9f7-180c-45a2-bd35-aa4e88aa3757 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:08 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be347340-05e9-4e4a-9ff5-eb94601d519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c790ce-aab2-41f3-8aa2-edc74de5a4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:08 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 1073741824 Sep 10 20:17:08 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:08 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Volume volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 (1b8a281b-3c8b-464b-8072-3d8e5ed02b40): created successfully Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c790ce-aab2-41f3-8aa2-edc74de5a4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Flow 'volume_create_manager' (b1eebd57-2a22-46e5-8485-93c6b5106234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:08 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-35580fb6-3974-4969-aac0-82dba3a57863 tempest-AttachVolumeNegativeTest-2145474300 None] Created volume successfully. Sep 10 20:17:08 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 1073741824" returned: 0 in 0.435s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:08 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 Sep 10 20:17:08 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Acquiring lock "cinder-ecff2228-8144-440b-aa75-0e763848067a-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Lock "cinder-ecff2228-8144-440b-aa75-0e763848067a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Acquiring lock "cinder-quobyte-ecff2228-8144-440b-aa75-0e763848067a" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Lock "cinder-quobyte-ecff2228-8144-440b-aa75-0e763848067a" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4585853-23d3-4348-8d6f-1d9ed8194a0c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:08 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757" returned: 0 in 0.295s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-6d3e0ff7-3208-4177-9cf9-eb2c9d72c924 req-d88ac310-ea70-480a-92a7-7390bebcdb56 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.660s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-6d3e0ff7-3208-4177-9cf9-eb2c9d72c924 req-d88ac310-ea70-480a-92a7-7390bebcdb56 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:08 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Attempting download of c218b189-9c4b-4bfd-845c-d69859c25477 ((None, [{'url': 'file:///opt/stack/data/glance/images/c218b189-9c4b-4bfd-845c-d69859c25477', 'metadata': {}}])) to volume 00ddc9f7-180c-45a2-bd35-aa4e88aa3757. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-6d3e0ff7-3208-4177-9cf9-eb2c9d72c924 req-d88ac310-ea70-480a-92a7-7390bebcdb56 tempest-TestInstancesWithCinderVolumes-1561640475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41778b63-7021-4494-a01a-023b2e840f03', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:17:09 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a Sep 10 20:17:09 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ffadd3-1558-4274-945e-7bd38175f9e0]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c218b189-9c4b-4bfd-845c-d69859c25477_tkp6cjkb {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:09 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-6d3e0ff7-3208-4177-9cf9-eb2c9d72c924 req-d88ac310-ea70-480a-92a7-7390bebcdb56 tempest-TestInstancesWithCinderVolumes-1561640475 None] attachment_update completed successfully. Sep 10 20:17:09 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c218b189-9c4b-4bfd-845c-d69859c25477_tkp6cjkb Sep 10 20:17:09 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:09 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a" returned: 0 in 0.497s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:09 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a Sep 10 20:17:09 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:09 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c218b189-9c4b-4bfd-845c-d69859c25477_tkp6cjkb" returned: 0 in 0.421s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c218b189-9c4b-4bfd-845c-d69859c25477_tkp6cjkb {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:09 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c218b189-9c4b-4bfd-845c-d69859c25477_tkp6cjkb Sep 10 20:17:09 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:09 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ecff2228-8144-440b-aa75-0e763848067a" returned: 0 in 0.448s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Lock "cinder-quobyte-ecff2228-8144-440b-aa75-0e763848067a" released by "delete_volume" :: held 0.992s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:09 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c218b189-9c4b-4bfd-845c-d69859c25477_tkp6cjkb" returned: 1 in 0.455s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c218b189-9c4b-4bfd-845c-d69859c25477_tkp6cjkb' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b726489e-7453-4869-91b2-aaad51468ed9]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:09 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Created reservations ['d62c90a0-5b9b-4312-90c7-ba33bf649e1f', 'bc9b11c3-ab51-4846-95a9-02a9d99d6b2f', '753c3568-22f3-4c3e-8ea9-2c1efdd7bf8b', 'e0d1cf77-942a-4700-b141-4565094e3ac0'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-e77a1dc2-f009-4542-a17b-070e647b6ab6 req-3c5264ad-bbff-480b-934e-be9b8a2f1c10 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-e77a1dc2-f009-4542-a17b-070e647b6ab6 req-3c5264ad-bbff-480b-934e-be9b8a2f1c10 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-e77a1dc2-f009-4542-a17b-070e647b6ab6 req-3c5264ad-bbff-480b-934e-be9b8a2f1c10 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:10 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD Sep 10 20:17:10 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-e77a1dc2-f009-4542-a17b-070e647b6ab6 req-3c5264ad-bbff-480b-934e-be9b8a2f1c10 tempest-AttachVolumeNegativeTest-2145474300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46188669-ad73-4621-935d-51690582a504', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:17:10 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:10 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:10 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-e77a1dc2-f009-4542-a17b-070e647b6ab6 req-3c5264ad-bbff-480b-934e-be9b8a2f1c10 tempest-AttachVolumeNegativeTest-2145474300 None] attachment_update completed successfully. Sep 10 20:17:10 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:10 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.284s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:10 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Deleted volume successfully. Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f61c46ac-91cf-425e-bc16-0f43d0dbd522 tempest-TestImageHashVerification-1393494477 None] Lock "cinder-ecff2228-8144-440b-aa75-0e763848067a-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:10 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD Sep 10 20:17:10 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:10 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] c218b189-9c4b-4bfd-845c-d69859c25477 was raw, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:17:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:10 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 Sep 10 20:17:10 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:11 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757" returned: 0 in 0.651s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c218b189-9c4b-4bfd-845c-d69859c25477_bato5glfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:17:11 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:11 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 1G Sep 10 20:17:11 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:11 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 1G" returned: 0 in 0.391s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Downloaded image c218b189-9c4b-4bfd-845c-d69859c25477 ((None, [{'url': 'file:///opt/stack/data/glance/images/c218b189-9c4b-4bfd-845c-d69859c25477', 'metadata': {}}])) to volume 00ddc9f7-180c-45a2-bd35-aa4e88aa3757 successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Temporary image c218b189-9c4b-4bfd-845c-d69859c25477 for user 92886bcea30e4447b4adfb2047e79031 is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Marking volume 00ddc9f7-180c-45a2-bd35-aa4e88aa3757 as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Copying metadata from image c218b189-9c4b-4bfd-845c-d69859c25477 to 00ddc9f7-180c-45a2-bd35-aa4e88aa3757. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Creating volume glance metadata for volume 00ddc9f7-180c-45a2-bd35-aa4e88aa3757 backed by image c218b189-9c4b-4bfd-845c-d69859c25477 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c218b189-9c4b-4bfd-845c-d69859c25477', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '16f4c5dd8f25ba787ad8817c3af25213', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c186c6f-3b55-4e64-9a4f-1f0d2a49f7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757', 'volume_size': 1, 'image_id': 'c218b189-9c4b-4bfd-845c-d69859c25477', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c218b189-9c4b-4bfd-845c-d69859c25477', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16f4c5dd8f25ba787ad8817c3af25213', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38b56d7dfb0c4c48b58d860aa5aab529', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c3fcb69cc11457c121590a96d540cdc36959f7f643ec42b37d3ef61022e70db36ad96dedd16d6169dcaef1cf4bae913841610a0c4e0b99404af111aa554ca11', 'id': 'c218b189-9c4b-4bfd-845c-d69859c25477', 'created_at': datetime.datetime(2026, 9, 10, 18, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 16, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c218b189-9c4b-4bfd-845c-d69859c25477/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79485df-300c-4051-9fc9-419313f75cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:11 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Volume volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 (00ddc9f7-180c-45a2-bd35-aa4e88aa3757): created successfully Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79485df-300c-4051-9fc9-419313f75cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Flow 'volume_create_manager' (eb9acd36-be98-4c6e-a2b4-3a2deb5bc656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:11 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-32a78edc-04b4-4af6-853b-e3ca9f7e9c27 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Created volume successfully. Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-bdbb3ad2-6439-47bc-b8c7-cb3865b22a4f req-8f36ff0c-4ed4-45c5-949c-2c4bd777b0a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-bdbb3ad2-6439-47bc-b8c7-cb3865b22a4f req-8f36ff0c-4ed4-45c5-949c-2c4bd777b0a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-bdbb3ad2-6439-47bc-b8c7-cb3865b22a4f req-8f36ff0c-4ed4-45c5-949c-2c4bd777b0a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-bdbb3ad2-6439-47bc-b8c7-cb3865b22a4f req-8f36ff0c-4ed4-45c5-949c-2c4bd777b0a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-b0e666e3-30aa-44fb-9326-517c8f523d44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b701569-c7e6-48db-aae5-3874f6ae2726', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:17:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-6e2ed8ad-73d1-48f9-8cb0-6d9ddd86efb9 req-1d082b49-c4f6-43ec-b826-da384075873a tempest-AttachVolumeNegativeTest-2145474300 None] Terminate volume connection completed successfully. Sep 10 20:17:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-6e2ed8ad-73d1-48f9-8cb0-6d9ddd86efb9 req-1d082b49-c4f6-43ec-b826-da384075873a tempest-AttachVolumeNegativeTest-2145474300 None] Deleting attachment 46188669-ad73-4621-935d-51690582a504. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:17:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-bdbb3ad2-6439-47bc-b8c7-cb3865b22a4f req-8f36ff0c-4ed4-45c5-949c-2c4bd777b0a8 tempest-TestInstancesWithCinderVolumes-1561640475 None] attachment_update completed successfully. Sep 10 20:17:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Acquiring lock "cinder-00ddc9f7-180c-45a2-bd35-aa4e88aa3757-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "cinder-00ddc9f7-180c-45a2-bd35-aa4e88aa3757-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Acquiring lock "cinder-quobyte-00ddc9f7-180c-45a2-bd35-aa4e88aa3757" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "cinder-quobyte-00ddc9f7-180c-45a2-bd35-aa4e88aa3757" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:12 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7d6a25-bde3-4330-8c46-ba7980975073]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:12 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 Sep 10 20:17:12 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:13 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757" returned: 0 in 0.556s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:13 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757 Sep 10 20:17:13 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:13 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-00ddc9f7-180c-45a2-bd35-aa4e88aa3757" returned: 0 in 0.314s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "cinder-quobyte-00ddc9f7-180c-45a2-bd35-aa4e88aa3757" released by "delete_volume" :: held 0.962s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:13 devstack cinder-volume[88137]: WARNING cinder.quota [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:17:13 devstack cinder-volume[88137]: WARNING cinder.quota [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Created reservations ['7b9fa325-4ffa-4a1f-a4b4-61593a2dad0c', '73559043-3039-4944-ab65-6352b802c024', '0c1ad46d-473f-40d9-85d5-f7192857cce3', 'c4c65d05-415e-45a6-b5ee-0919b502ff4d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:13 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:13 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:14 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.353s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:14 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Deleted volume successfully. Sep 10 20:17:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-03212d09-0450-4161-a722-45c8c5745c74 tempest-VolumeAndVolumeTypeFromImageTest-83829683 None] Lock "cinder-00ddc9f7-180c-45a2-bd35-aa4e88aa3757-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-8f33d0d2-aa3d-4c5b-b078-acff4a4806eb req-1c4968c6-552c-4868-a036-50bc9149aa09 tempest-TestInstancesWithCinderVolumes-1561640475 None] Terminate volume connection completed successfully. Sep 10 20:17:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-8f33d0d2-aa3d-4c5b-b078-acff4a4806eb req-1c4968c6-552c-4868-a036-50bc9149aa09 tempest-TestInstancesWithCinderVolumes-1561640475 None] Deleting attachment 41778b63-7021-4494-a01a-023b2e840f03. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:17:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "cinder-f7629d4c-3547-4c3e-afb3-e9fc45231d54-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-f7629d4c-3547-4c3e-afb3-e9fc45231d54-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "cinder-quobyte-f7629d4c-3547-4c3e-afb3-e9fc45231d54" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-quobyte-f7629d4c-3547-4c3e-afb3-e9fc45231d54" acquired by "delete_volume" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:19 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b9f03-86f7-4a11-b0a0-23d79de801cd]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:19 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 Sep 10 20:17:19 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:20 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54" returned: 0 in 0.641s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:20 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54 Sep 10 20:17:20 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:20 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:20 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:20 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f7629d4c-3547-4c3e-afb3-e9fc45231d54" returned: 0 in 0.474s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-quobyte-f7629d4c-3547-4c3e-afb3-e9fc45231d54" released by "delete_volume" :: held 1.185s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:20 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:20 devstack cinder-volume[88137]: WARNING cinder.quota [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098818321-1347946899 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098818321-1347946899, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:17:20 devstack cinder-volume[88137]: WARNING cinder.quota [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098818321-1347946899 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1098818321-1347946899, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.484s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:17:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Created reservations ['558bef9d-9446-4445-9b7d-187fcbfedb4c', '29aaf1df-d64c-4c15-b88b-0fac78b8b18b', 'ea485563-36d3-4781-9dbe-9a6dcf4a6580', 'ddee6bdb-d026-49cc-9cc4-4de6865be687'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:21 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:21 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:21 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.332s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Deleted volume successfully. Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5bde0366-cf51-4159-bf34-1ff8c5916c17 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-f7629d4c-3547-4c3e-afb3-e9fc45231d54-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Flow 'volume_create_manager' (40991ee7-b3fe-4989-8bc0-4d103107577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0d9f21-5671-40d0-bb9f-b27257bde066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0d9f21-5671-40d0-bb9f-b27257bde066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-755610203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c57da3-9805-4398-bead-0026ea06be10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d8c16c85ca24f9aa1933e2094783edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:22Z,use_quota=True,user_id='22a35ad8d16445df996b1312817b1899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338ea5b9-08ce-4dcf-b5f2-0fd3c1c10b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338ea5b9-08ce-4dcf-b5f2-0fd3c1c10b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e579cb-856b-4994-bd84-c1765e49a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e579cb-856b-4994-bd84-c1765e49a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c57da3-9805-4398-bead-0026ea06be10', 'volume_name': 'volume-44c57da3-9805-4398-bead-0026ea06be10', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48db6ab-42f5-4508-8ed2-22f6ec06fe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48db6ab-42f5-4508-8ed2-22f6ec06fe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6e55e7-0b5f-440b-93a8-65aac608968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:21 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Volume 44c57da3-9805-4398-bead-0026ea06be10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c57da3-9805-4398-bead-0026ea06be10', 'volume_size': 1} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-755610203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c57da3-9805-4398-bead-0026ea06be10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d8c16c85ca24f9aa1933e2094783edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:22Z,use_quota=True,user_id='22a35ad8d16445df996b1312817b1899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Creating volume 44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:21 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:17:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:21 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 1073741824 Sep 10 20:17:21 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:22 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 1073741824" returned: 0 in 0.808s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:22 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 Sep 10 20:17:22 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:23 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10" returned: 0 in 0.415s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:17:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6e55e7-0b5f-440b-93a8-65aac608968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c57da3-9805-4398-bead-0026ea06be10', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26be934a-89d0-4e18-8f9e-a9707c7ff8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:23 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Volume volume-44c57da3-9805-4398-bead-0026ea06be10 (44c57da3-9805-4398-bead-0026ea06be10): created successfully Sep 10 20:17:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26be934a-89d0-4e18-8f9e-a9707c7ff8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Flow 'volume_create_manager' (40991ee7-b3fe-4989-8bc0-4d103107577e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-84a74dcb-10d4-44b2-9eab-be93c6c6a3e0 tempest-VolumeDependencyTests-245256739 None] Created volume successfully. Sep 10 20:17:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Creating offline snapshot 99f35f85-b23b-4e6b-8533-612e2fb80e59 of volume 44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:17:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b765d2c-a89d-4afa-90e5-970156e2ebc4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:24 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-0bc2d16e-c599-4fe3-abe5-c2001d1c6727 req-87e1d56e-2e9a-4391-940b-449a209783de tempest-TestInstancesWithCinderVolumes-1561640475 None] Terminate volume connection completed successfully. Sep 10 20:17:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-0bc2d16e-c599-4fe3-abe5-c2001d1c6727 req-87e1d56e-2e9a-4391-940b-449a209783de tempest-TestInstancesWithCinderVolumes-1561640475 None] Deleting attachment 1b701569-c7e6-48db-aae5-3874f6ae2726. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:17:24 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 Sep 10 20:17:24 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:24 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10" returned: 0 in 0.531s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:24 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 1G Sep 10 20:17:24 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "cinder-b0e666e3-30aa-44fb-9326-517c8f523d44-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-b0e666e3-30aa-44fb-9326-517c8f523d44-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "cinder-quobyte-b0e666e3-30aa-44fb-9326-517c8f523d44" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-quobyte-b0e666e3-30aa-44fb-9326-517c8f523d44" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:25 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef84c065-70c4-44ba-aa3b-095ce955a1a0]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:25 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44 Sep 10 20:17:25 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:25 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 1G" returned: 0 in 0.918s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c57da3-9805-4398-bead-0026ea06be10 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:25 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c57da3-9805-4398-bead-0026ea06be10 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 Sep 10 20:17:25 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:26 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44" returned: 0 in 0.726s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:26 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44 Sep 10 20:17:26 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:26 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b0e666e3-30aa-44fb-9326-517c8f523d44" returned: 0 in 0.376s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-quobyte-b0e666e3-30aa-44fb-9326-517c8f523d44" released by "delete_volume" :: held 1.198s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:26 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c57da3-9805-4398-bead-0026ea06be10 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59" returned: 0 in 0.761s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:26 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 is being set with open permissions: ugo+rw Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:26 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 Sep 10 20:17:26 devstack cinder-volume[88137]: WARNING cinder.quota [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-919952804-799582938 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-919952804-799582938, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:17:26 devstack cinder-volume[88137]: WARNING cinder.quota [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-919952804-799582938 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-919952804-799582938, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:17:26 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Created reservations ['e4b98d18-0295-4f19-96a8-9f2baa6e4f01', 'd9295cb7-4cdf-4d27-8fa8-d7e4654ab77d', 'e67c2588-dfda-4351-8eb0-86057828286b', '1c856b3d-49d4-4eb5-b49d-efc5649e227e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:26 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:26 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:26 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59" returned: 0 in 0.414s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:26 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.info Sep 10 20:17:26 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:27 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.394s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:27 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Deleted volume successfully. Sep 10 20:17:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94123676-2cce-460f-b931-a7d90bdcdd5f tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-b0e666e3-30aa-44fb-9326-517c8f523d44-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:27 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.info" returned: 0 in 0.370s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:27 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.info is being set with open permissions: ugo+rw Sep 10 20:17:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:27 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.info Sep 10 20:17:27 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:27 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.info" returned: 0 in 0.377s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.524s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-64d7a91a-68bb-40b6-865f-66c1dcecf108 tempest-VolumeDependencyTests-245256739 None] Create snapshot completed successfully Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (5062c3be-19fc-447f-b836-a3a2f114f1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b0829d-34e6-4917-bbd1-c2bb801d87c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b0829d-34e6-4917-bbd1-c2bb801d87c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1772145310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcffd2c-ac04-4e3b-99e8-697be6385f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:29Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cbaabc-8769-42f8-9675-23d5d2ae1b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cbaabc-8769-42f8-9675-23d5d2ae1b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9bcb94-79d9-412b-9cc1-c152ee5da5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9bcb94-79d9-412b-9cc1-c152ee5da5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edcffd2c-ac04-4e3b-99e8-697be6385f12', 'volume_name': 'volume-edcffd2c-ac04-4e3b-99e8-697be6385f12', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d110a5-5418-4e67-bb6d-d67595d8876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d110a5-5418-4e67-bb6d-d67595d8876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afa82d5-a399-4e42-8ed1-793d30bcb29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:28 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Volume edcffd2c-ac04-4e3b-99e8-697be6385f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edcffd2c-ac04-4e3b-99e8-697be6385f12', 'volume_size': 1} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1772145310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcffd2c-ac04-4e3b-99e8-697be6385f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:29Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Creating volume edcffd2c-ac04-4e3b-99e8-697be6385f12 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:28 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:17:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:28 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 1073741824 Sep 10 20:17:28 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (3e1dd346-038f-47fa-889b-e2e95ff4203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9104d8-5653-4e88-bd88-b6af11c6e721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9104d8-5653-4e88-bd88-b6af11c6e721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932460076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ab144d-624a-407d-91c4-fb1c82796b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:29Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b87098-4657-40ae-87d4-e4348d51d387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b87098-4657-40ae-87d4-e4348d51d387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60c5cce-2c3f-4adb-a904-fc1d527f9b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60c5cce-2c3f-4adb-a904-fc1d527f9b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ab144d-624a-407d-91c4-fb1c82796b69', 'volume_name': 'volume-a3ab144d-624a-407d-91c4-fb1c82796b69', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1d3c95-9850-45b0-96ba-bc1761862ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1d3c95-9850-45b0-96ba-bc1761862ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee79927a-75b2-4241-8650-f3868b9275ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:29 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Volume a3ab144d-624a-407d-91c4-fb1c82796b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ab144d-624a-407d-91c4-fb1c82796b69', 'volume_size': 1} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:29 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 1073741824" returned: 0 in 0.851s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:29 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 Sep 10 20:17:29 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:30 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12" returned: 0 in 0.771s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932460076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ab144d-624a-407d-91c4-fb1c82796b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:29Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Creating volume a3ab144d-624a-407d-91c4-fb1c82796b69 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:30 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afa82d5-a399-4e42-8ed1-793d30bcb29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edcffd2c-ac04-4e3b-99e8-697be6385f12', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:30 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69 1073741824 Sep 10 20:17:30 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8302783-9eb7-4403-91cf-938b3f2b7729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Volume volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 (edcffd2c-ac04-4e3b-99e8-697be6385f12): created successfully Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8302783-9eb7-4403-91cf-938b3f2b7729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (5062c3be-19fc-447f-b836-a3a2f114f1db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ed645a10-2c5d-447b-aa61-b6e9c778424f tempest-CreateVolumesFromImageTest-2037700148 None] Created volume successfully. Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (291ae47f-80e2-42e5-afe6-13a8ecb0cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa688f2-6757-4752-81f2-c3f86a0e1b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa688f2-6757-4752-81f2-c3f86a0e1b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424147751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293ce02c-931c-4491-8a44-ba7af9bd794f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:30Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d9cbf1-2de0-4684-8e6f-8ae37b711aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d9cbf1-2de0-4684-8e6f-8ae37b711aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c74622f-7d83-4dca-b9a6-a7e6a595cb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c74622f-7d83-4dca-b9a6-a7e6a595cb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '293ce02c-931c-4491-8a44-ba7af9bd794f', 'volume_name': 'volume-293ce02c-931c-4491-8a44-ba7af9bd794f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200670cc-4449-4cd3-84a6-cfdfa90249ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:31 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200670cc-4449-4cd3-84a6-cfdfa90249ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a621c145-31e8-4cdf-a124-ce6cfed1944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Volume 293ce02c-931c-4491-8a44-ba7af9bd794f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-293ce02c-931c-4491-8a44-ba7af9bd794f', 'volume_size': 1} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69 1073741824" returned: 0 in 1.160s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:32 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69 Sep 10 20:17:32 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Flow 'volume_create_manager' (17a03452-7987-464b-857c-95f4c9f9d672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba18af1-7340-4f34-ac0e-61b815497409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba18af1-7340-4f34-ac0e-61b815497409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1038127184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61413ab-f118-4380-9aea-5250cafbd5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d8c16c85ca24f9aa1933e2094783edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99f35f85-b23b-4e6b-8533-612e2fb80e59,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:32Z,use_quota=True,user_id='22a35ad8d16445df996b1312817b1899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c35f75-a89a-4077-b49e-8e8c53b79261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c35f75-a89a-4077-b49e-8e8c53b79261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1a4a94-2759-4b9d-9cd1-99a678b01552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1a4a94-2759-4b9d-9cd1-99a678b01552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a61413ab-f118-4380-9aea-5250cafbd5ec', 'volume_name': 'volume-a61413ab-f118-4380-9aea-5250cafbd5ec', 'volume_size': 1, 'snapshot_id': '99f35f85-b23b-4e6b-8533-612e2fb80e59'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:32 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e18edfc-31e0-4ce8-884f-2a7ad777da8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e18edfc-31e0-4ce8-884f-2a7ad777da8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46401e1c-c818-48d2-b4c2-c4102546fcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Volume a61413ab-f118-4380-9aea-5250cafbd5ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a61413ab-f118-4380-9aea-5250cafbd5ec', 'volume_size': 1, 'snapshot_id': '99f35f85-b23b-4e6b-8533-612e2fb80e59'} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69" returned: 0 in 0.887s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.174s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424147751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293ce02c-931c-4491-8a44-ba7af9bd794f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:30Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Creating volume 293ce02c-931c-4491-8a44-ba7af9bd794f {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:32 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:32 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (1c9e3a60-2d01-4b05-b528-1f4941a2d783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:33 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f 1073741824 Sep 10 20:17:33 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c00a492-d003-4ab8-bfe0-9eee01a5ecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee79927a-75b2-4241-8650-f3868b9275ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ab144d-624a-407d-91c4-fb1c82796b69', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0b1817-e994-4154-a7cf-5d8edf3c70a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c00a492-d003-4ab8-bfe0-9eee01a5ecd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-591034510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39e0fef-920a-467a-b735-cbfd8a1bbd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:33Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a45c9ad-151e-4ffd-a832-9bf244ac7fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a45c9ad-151e-4ffd-a832-9bf244ac7fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65a0e4a-15ed-42eb-9b4f-f181ff1c691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65a0e4a-15ed-42eb-9b4f-f181ff1c691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39e0fef-920a-467a-b735-cbfd8a1bbd77', 'volume_name': 'volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443bdc1c-1708-4ff6-8f95-19bef064871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443bdc1c-1708-4ff6-8f95-19bef064871f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0f62ee-6134-4861-8e43-b24a1f7fd8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Volume c39e0fef-920a-467a-b735-cbfd8a1bbd77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77', 'volume_size': 1} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Volume volume-a3ab144d-624a-407d-91c4-fb1c82796b69 (a3ab144d-624a-407d-91c4-fb1c82796b69): created successfully Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0b1817-e994-4154-a7cf-5d8edf3c70a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (3e1dd346-038f-47fa-889b-e2e95ff4203e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f86d2fde-f048-4beb-9ca0-f8b154b1d017 tempest-CreateVolumesFromImageTest-2037700148 None] Created volume successfully. Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (73877cdf-f6cc-400e-b88d-54a34a2c2ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b0ff9f-763c-48e9-9813-6f0cac2e0647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b0ff9f-763c-48e9-9813-6f0cac2e0647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305929549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbb5bb1-8183-43c2-a809-d2f80a824962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:33Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2badef58-c84e-425c-848a-6dd1db56c991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2badef58-c84e-425c-848a-6dd1db56c991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e09cd0-6c7c-49b6-b408-36ba2b8e1c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e09cd0-6c7c-49b6-b408-36ba2b8e1c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bbb5bb1-8183-43c2-a809-d2f80a824962', 'volume_name': 'volume-7bbb5bb1-8183-43c2-a809-d2f80a824962', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918e3876-e79f-4d91-9b1a-359c58df9ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918e3876-e79f-4d91-9b1a-359c58df9ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ecc413-6cfb-4254-8c1d-bf31f760b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Volume 7bbb5bb1-8183-43c2-a809-d2f80a824962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bbb5bb1-8183-43c2-a809-d2f80a824962', 'volume_size': 1} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:33 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f 1073741824" returned: 0 in 0.982s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:34 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f Sep 10 20:17:34 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-1217a6f4-4ef7-4b2a-aa60-1d5dde7dc117 req-e8361bba-0de2-4956-807d-d4f97bd0dbe1 tempest-TestInstancesWithCinderVolumes-1561640475 None] Terminate volume connection completed successfully. Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-1217a6f4-4ef7-4b2a-aa60-1d5dde7dc117 req-e8361bba-0de2-4956-807d-d4f97bd0dbe1 tempest-TestInstancesWithCinderVolumes-1561640475 None] Deleting attachment 9df4f1f8-ff99-41fe-ad12-69d09c3221dd. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:17:34 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f" returned: 0 in 0.657s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.597s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Acquiring lock "cinder-quobyte-99f35f85-b23b-4e6b-8533-612e2fb80e59-a61413ab-f118-4380-9aea-5250cafbd5ec" by "_create_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a621c145-31e8-4cdf-a124-ce6cfed1944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-293ce02c-931c-4491-8a44-ba7af9bd794f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ec57bb-18dc-42ce-9159-2bbb51c20d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-99f35f85-b23b-4e6b-8533-612e2fb80e59-a61413ab-f118-4380-9aea-5250cafbd5ec" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Creating volume a61413ab-f118-4380-9aea-5250cafbd5ec from snapshot 99f35f85-b23b-4e6b-8533-612e2fb80e59 {{(pid=88137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Acquiring lock "cinder-quobyte-a61413ab-f118-4380-9aea-5250cafbd5ec" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:34 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Volume volume-293ce02c-931c-4491-8a44-ba7af9bd794f (293ce02c-931c-4491-8a44-ba7af9bd794f): created successfully Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ec57bb-18dc-42ce-9159-2bbb51c20d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (291ae47f-80e2-42e5-afe6-13a8ecb0cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-a61413ab-f118-4380-9aea-5250cafbd5ec" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] snapshot: 99f35f85-b23b-4e6b-8533-612e2fb80e59, volume: a61413ab-f118-4380-9aea-5250cafbd5ec, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:17:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2f5681e6-a61b-4696-8825-a23a6f579105 tempest-CreateVolumesFromImageTest-2037700148 None] Created volume successfully. Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d20a6a4-c28f-48a6-bffb-e2ca30e915bb]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:35 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 Sep 10 20:17:35 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:35 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59" returned: 0 in 0.629s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44c57da3-9805-4398-bead-0026ea06be10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9b5e96-9c18-4867-ab77-60ba681a688b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:35 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 Sep 10 20:17:35 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "cinder-b13cf803-a258-47e5-9a4f-335b5e2be249-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-b13cf803-a258-47e5-9a4f-335b5e2be249-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "cinder-quobyte-b13cf803-a258-47e5-9a4f-335b5e2be249" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-quobyte-b13cf803-a258-47e5-9a4f-335b5e2be249" acquired by "delete_volume" :: waited 0.033s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d4a6c-96b9-45e3-a1bd-5c61cf4ca58e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:36 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 Sep 10 20:17:36 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:36 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10" returned: 0 in 0.690s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:17:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:17:36 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:17:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:36 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec Sep 10 20:17:36 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:36 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249" returned: 0 in 0.585s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:36 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249 Sep 10 20:17:36 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:36 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b13cf803-a258-47e5-9a4f-335b5e2be249" returned: 0 in 0.332s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-quobyte-b13cf803-a258-47e5-9a4f-335b5e2be249" released by "delete_volume" :: held 1.028s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:37 devstack cinder-volume[88137]: WARNING cinder.quota [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1145390333-1581123956 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1145390333-1581123956, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:17:37 devstack cinder-volume[88137]: WARNING cinder.quota [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1145390333-1581123956 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1145390333-1581123956, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:17:37 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Created reservations ['509afd91-e6f3-4182-926a-6a39147f5992', '902e2060-b98a-46d7-a007-8e732cabad64', 'c96bc138-4ebd-4fe5-9837-3fb0e34c9b10', 'bdad9b9d-b19d-4849-9f7f-223957c31181'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:37 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:37 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:38 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 1.101s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:38 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Deleted volume successfully. Sep 10 20:17:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-62648d95-5af9-43b5-99ab-0eddfab4ca25 tempest-TestInstancesWithCinderVolumes-1561640475 None] Lock "cinder-b13cf803-a258-47e5-9a4f-335b5e2be249-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:43 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec" returned: 0 in 7.561s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:43 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:17:43 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Converted 1024.00 MB image at 135.41 MB/s Sep 10 20:17:43 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec is being set with open permissions: ugo+rw Sep 10 20:17:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:43 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec Sep 10 20:17:43 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:44 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec" returned: 0 in 0.352s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-a61413ab-f118-4380-9aea-5250cafbd5ec" released by "_copy_volume_from_snapshot" :: held 9.399s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-99f35f85-b23b-4e6b-8533-612e2fb80e59-a61413ab-f118-4380-9aea-5250cafbd5ec" released by "_create_volume_from_snapshot" :: held 9.523s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.580s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.056s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-591034510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39e0fef-920a-467a-b735-cbfd8a1bbd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:33Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Creating volume c39e0fef-920a-467a-b735-cbfd8a1bbd77 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:44 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:44 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 1073741824 Sep 10 20:17:44 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46401e1c-c818-48d2-b4c2-c4102546fcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61413ab-f118-4380-9aea-5250cafbd5ec', 'volume_size': 1, 'snapshot_id': '99f35f85-b23b-4e6b-8533-612e2fb80e59'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d567d624-8e15-4341-be82-a09098fa7473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:44 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Volume volume-a61413ab-f118-4380-9aea-5250cafbd5ec (a61413ab-f118-4380-9aea-5250cafbd5ec): created successfully Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d567d624-8e15-4341-be82-a09098fa7473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Flow 'volume_create_manager' (17a03452-7987-464b-857c-95f4c9f9d672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-095151ea-b9f5-400a-a4b2-244b8a35da1e tempest-VolumeDependencyTests-245256739 None] Created volume successfully. Sep 10 20:17:44 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 1073741824" returned: 0 in 0.648s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:44 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 Sep 10 20:17:44 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "cinder-99f35f85-b23b-4e6b-8533-612e2fb80e59-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-99f35f85-b23b-4e6b-8533-612e2fb80e59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "cinder-quobyte-44c57da3-9805-4398-bead-0026ea06be10" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-44c57da3-9805-4398-bead-0026ea06be10" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "cinder-quobyte-99f35f85-b23b-4e6b-8533-612e2fb80e59" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-99f35f85-b23b-4e6b-8533-612e2fb80e59" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Deleting offline snapshot 99f35f85-b23b-4e6b-8533-612e2fb80e59 of volume 44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] snapshot_file for this snap is: volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4e8781-ea0c-4c85-9906-8e34003e4160]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:45 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77" returned: 0 in 0.407s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.971s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305929549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbb5bb1-8183-43c2-a809-d2f80a824962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e095d8b81f44824bbf96cc558b7f755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:33Z,use_quota=True,user_id='ba59a84186a942d9adaea34327dc6590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Creating volume 7bbb5bb1-8183-43c2-a809-d2f80a824962 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:45 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0f62ee-6134-4861-8e43-b24a1f7fd8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c4c825-62fd-439a-a79e-963d6ae652e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:45 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 1073741824 Sep 10 20:17:45 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:45 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Volume volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 (c39e0fef-920a-467a-b735-cbfd8a1bbd77): created successfully Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c4c825-62fd-439a-a79e-963d6ae652e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (1c9e3a60-2d01-4b05-b528-1f4941a2d783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:45 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-22e18edb-0d43-43ab-9f1c-4f47e03a140f tempest-CreateVolumesFromImageTest-2037700148 None] Created volume successfully. Sep 10 20:17:45 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 Sep 10 20:17:45 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:45 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59" returned: 0 in 0.423s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44c57da3-9805-4398-bead-0026ea06be10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ffdab9-38b2-4681-9374-480631f7d1dc]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:45 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 Sep 10 20:17:45 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:45 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 1073741824" returned: 0 in 0.598s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:46 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 Sep 10 20:17:46 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:46 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962" returned: 0 in 0.275s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ecc413-6cfb-4254-8c1d-bf31f760b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bbb5bb1-8183-43c2-a809-d2f80a824962', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed35f5b0-7cdd-42df-9fc3-825fad9ca77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:46 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Volume volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 (7bbb5bb1-8183-43c2-a809-d2f80a824962): created successfully Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed35f5b0-7cdd-42df-9fc3-825fad9ca77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Flow 'volume_create_manager' (73877cdf-f6cc-400e-b88d-54a34a2c2ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-74a12a66-db6f-4371-976c-c4604c00c350 tempest-CreateVolumesFromImageTest-2037700148 None] Created volume successfully. Sep 10 20:17:46 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10" returned: 0 in 0.658s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:46 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 Sep 10 20:17:46 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:46 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59" returned: 0 in 0.368s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:46 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59 Sep 10 20:17:46 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-7bbb5bb1-8183-43c2-a809-d2f80a824962-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-7bbb5bb1-8183-43c2-a809-d2f80a824962-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:47 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10.99f35f85-b23b-4e6b-8533-612e2fb80e59" returned: 0 in 0.371s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-quobyte-7bbb5bb1-8183-43c2-a809-d2f80a824962" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-99f35f85-b23b-4e6b-8533-612e2fb80e59" released by "_delete_snapshot" :: held 1.970s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-7bbb5bb1-8183-43c2-a809-d2f80a824962" acquired by "delete_volume" :: waited 0.055s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-44c57da3-9805-4398-bead-0026ea06be10" released by "delete_snapshot" :: held 2.027s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7bc73-4e13-47b2-9216-42a38b06f79b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Created reservations ['3d28783b-f9ad-4b05-9df6-435649987258', '4e019e39-14c9-4250-af62-39183e44efc0', '9819edad-ddfa-4663-aa1d-2a7333100067', 'cedd3d24-0d56-44d7-b594-42276fb8a0d5'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:47 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 Sep 10 20:17:47 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:47 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Delete snapshot completed successfully. Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-083b2520-81ab-4968-8f1f-859cc25cdc24 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-99f35f85-b23b-4e6b-8533-612e2fb80e59-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:47 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962" returned: 0 in 0.433s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:47 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962 Sep 10 20:17:47 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:48 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7bbb5bb1-8183-43c2-a809-d2f80a824962" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-7bbb5bb1-8183-43c2-a809-d2f80a824962" released by "delete_volume" :: held 0.807s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Created reservations ['22d42d00-7786-4249-9256-b99fa0f162e0', 'a030c4fd-d9c8-4542-acac-d4b96c77417f', 'a3cd89be-c95d-47f6-93b1-3102695e5d7e', 'bd226959-64fc-4568-a09c-3b2a66becb2f'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:48 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:48 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-c39e0fef-920a-467a-b735-cbfd8a1bbd77-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-c39e0fef-920a-467a-b735-cbfd8a1bbd77-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "cinder-44c57da3-9805-4398-bead-0026ea06be10-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-44c57da3-9805-4398-bead-0026ea06be10-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-quobyte-c39e0fef-920a-467a-b735-cbfd8a1bbd77" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-c39e0fef-920a-467a-b735-cbfd8a1bbd77" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "cinder-quobyte-44c57da3-9805-4398-bead-0026ea06be10" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fec8ba-912f-4581-8fa8-f6eefbe5032c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-44c57da3-9805-4398-bead-0026ea06be10" acquired by "delete_volume" :: waited 0.046s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:48 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.394s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Deleted volume successfully. Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[10304128-11fb-44af-9b41-34a1731329d6]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6cee7b6e-2843-4512-b723-08e3c541280a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-7bbb5bb1-8183-43c2-a809-d2f80a824962-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:48 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 Sep 10 20:17:48 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:48 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 Sep 10 20:17:48 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:48 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77" returned: 0 in 0.415s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:49 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77 Sep 10 20:17:49 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:49 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10" returned: 0 in 0.443s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:49 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10 Sep 10 20:17:49 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:49 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c39e0fef-920a-467a-b735-cbfd8a1bbd77" returned: 0 in 0.326s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-c39e0fef-920a-467a-b735-cbfd8a1bbd77" released by "delete_volume" :: held 0.811s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Created reservations ['d58426fb-51f7-47d2-9962-417dc8cd9f55', '2147fd2a-ff06-434e-a85c-b9d485982949', '54bc3744-307c-4e2f-9d94-1b3247a15241', '252999cf-58fa-456f-ac7b-54385fe1e5c0'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:49 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44c57da3-9805-4398-bead-0026ea06be10" returned: 0 in 0.328s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-44c57da3-9805-4398-bead-0026ea06be10" released by "delete_volume" :: held 0.853s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Created reservations ['e6f90e06-ccbe-4101-80ba-a9099c67763c', '001a0e0f-78f4-4d25-be38-c4babab574b4', '909d3a6e-d63e-474e-9409-99ae6e7d5b27', 'd963511d-2cb0-4889-ab82-b695c9917b51'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:49 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:49 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-293ce02c-931c-4491-8a44-ba7af9bd794f-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-293ce02c-931c-4491-8a44-ba7af9bd794f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "cinder-a61413ab-f118-4380-9aea-5250cafbd5ec-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-a61413ab-f118-4380-9aea-5250cafbd5ec-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:49 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:49 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-quobyte-293ce02c-931c-4491-8a44-ba7af9bd794f" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "cinder-quobyte-a61413ab-f118-4380-9aea-5250cafbd5ec" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-293ce02c-931c-4491-8a44-ba7af9bd794f" acquired by "delete_volume" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-a61413ab-f118-4380-9aea-5250cafbd5ec" acquired by "delete_volume" :: waited 0.040s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec4c1e-c5e1-4daf-8a65-94b803b7e6b7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded1a0a2-bf1c-464e-8bb2-bd2c651681b1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:49 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.451s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:49 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Deleted volume successfully. Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3176ece9-2c7d-4108-8fb5-ae604fd63593 tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-c39e0fef-920a-467a-b735-cbfd8a1bbd77-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:50 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f Sep 10 20:17:50 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:50 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec Sep 10 20:17:50 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:50 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.458s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:50 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Deleted volume successfully. Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-52ff1a2a-8ead-4556-a049-876e18521d26 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-44c57da3-9805-4398-bead-0026ea06be10-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:50 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f" returned: 0 in 0.520s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:50 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f Sep 10 20:17:50 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec" returned: 0 in 0.528s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:50 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:50 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec Sep 10 20:17:50 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:50 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-293ce02c-931c-4491-8a44-ba7af9bd794f" returned: 0 in 0.281s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-293ce02c-931c-4491-8a44-ba7af9bd794f" released by "delete_volume" :: held 0.884s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:50 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a61413ab-f118-4380-9aea-5250cafbd5ec" returned: 0 in 0.286s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-quobyte-a61413ab-f118-4380-9aea-5250cafbd5ec" released by "delete_volume" :: held 0.903s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Created reservations ['55a98a5c-d3e9-4cd8-a2aa-df8c48f83a97', '14828343-2051-4f65-8b59-23151805e706', 'd9cb5c1d-ce4e-4530-8fb9-6509a8952e17', '4e38970d-00ef-4e37-b903-9d2a8057df03'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Created reservations ['517903f8-cc50-4ef3-93e5-a89f7ae29124', 'e0eff8f0-5057-49c2-8568-43b6d587fcbe', '33e82fe4-7ed3-41fd-ab41-e66e8d1f671b', 'f3ddf08b-31ff-47a2-819b-83a497809e97'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:51 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:51 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:51 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:51 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:51 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.300s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Deleted volume successfully. Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-94a557cb-6d88-4b87-ac9c-36d36fb1cfbd tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-293ce02c-931c-4491-8a44-ba7af9bd794f-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:51 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.321s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Deleted volume successfully. Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9efcfbd9-e2a3-43f3-8cf4-ff84660ee523 tempest-VolumeDependencyTests-245256739 None] Lock "cinder-a61413ab-f118-4380-9aea-5250cafbd5ec-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-a3ab144d-624a-407d-91c4-fb1c82796b69-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-a3ab144d-624a-407d-91c4-fb1c82796b69-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-quobyte-a3ab144d-624a-407d-91c4-fb1c82796b69" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-a3ab144d-624a-407d-91c4-fb1c82796b69" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:52 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfcacc9-3d81-4c1c-86da-6e2e92dda2a1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:52 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69 Sep 10 20:17:52 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:52 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69" returned: 0 in 0.633s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:52 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69 Sep 10 20:17:52 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:52 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a3ab144d-624a-407d-91c4-fb1c82796b69" returned: 0 in 0.310s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-a3ab144d-624a-407d-91c4-fb1c82796b69" released by "delete_volume" :: held 1.010s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Created reservations ['8290d235-3fe2-4eff-84b3-db2f04bf5afc', 'cb2a039b-19bc-4cad-a20a-320effd7a716', 'c43f5328-daa5-4b70-9592-282d6a703b90', 'f1e1a8a9-cd93-409f-8d25-98717f8b5727'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:53 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:53 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:53 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.340s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Deleted volume successfully. Sep 10 20:17:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5a28226f-62ef-438c-b645-3886bc2f3d8a tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-a3ab144d-624a-407d-91c4-fb1c82796b69-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-edcffd2c-ac04-4e3b-99e8-697be6385f12-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-edcffd2c-ac04-4e3b-99e8-697be6385f12-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "cinder-quobyte-edcffd2c-ac04-4e3b-99e8-697be6385f12" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:17:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-edcffd2c-ac04-4e3b-99e8-697be6385f12" acquired by "delete_volume" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:17:54 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bad1af-fec5-4c7d-bfd7-13d00a9b0896]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:17:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:54 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 Sep 10 20:17:54 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:54 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12" returned: 0 in 0.437s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:54 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12 Sep 10 20:17:54 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:55 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edcffd2c-ac04-4e3b-99e8-697be6385f12" returned: 0 in 0.305s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-quobyte-edcffd2c-ac04-4e3b-99e8-697be6385f12" released by "delete_volume" :: held 0.824s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Created reservations ['caee7321-53ff-45cf-8d95-5305cbb119ee', '662b2864-fe49-460c-9022-479525b0a4cf', 'cf8009d4-eadf-4a10-9913-8e42cfe23b9e', '5cdf560a-ce3a-4822-8df9-f5a7ef0350ca'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:55 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:17:55 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:55 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.359s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:17:55 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Deleted volume successfully. Sep 10 20:17:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8ea0fcf1-3e40-458a-8d02-82164c5d554e tempest-CreateVolumesFromImageTest-2037700148 None] Lock "cinder-edcffd2c-ac04-4e3b-99e8-697be6385f12-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=124,cinder:UPDATE=132,cinder:INSERT=32,cinder:DELETE=14 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=109,cinder:UPDATE=141,cinder:INSERT=39,cinder:DELETE=8 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Flow 'volume_create_manager' (bebda2c0-895a-4fa6-aab8-a4b8cbf41f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60188fa6-0b8c-4d37-937c-72b525a6a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60188fa6-0b8c-4d37-937c-72b525a6a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-257173416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a00b95-01d0-4c5d-ae39-3f010f783d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148e0b0dc5834fabbbc5714fa21ea6c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:58Z,use_quota=True,user_id='c9bf78f4ac0e441684eb139d09337974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9584b8e-809f-44ef-9023-c2572a903ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9584b8e-809f-44ef-9023-c2572a903ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd32d7f9-7f34-4bde-8d13-7c76e44a4cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd32d7f9-7f34-4bde-8d13-7c76e44a4cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a00b95-01d0-4c5d-ae39-3f010f783d43', 'volume_name': 'volume-89a00b95-01d0-4c5d-ae39-3f010f783d43', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad023fd-3e21-4f4d-ab6b-f525b0470f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad023fd-3e21-4f4d-ab6b-f525b0470f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94609b1-ea46-45b5-a6a0-d116ed9e5357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:57 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Volume 89a00b95-01d0-4c5d-ae39-3f010f783d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a00b95-01d0-4c5d-ae39-3f010f783d43', 'volume_size': 1} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-257173416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a00b95-01d0-4c5d-ae39-3f010f783d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148e0b0dc5834fabbbc5714fa21ea6c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:17:58Z,use_quota=True,user_id='c9bf78f4ac0e441684eb139d09337974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Creating volume 89a00b95-01d0-4c5d-ae39-3f010f783d43 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:17:57 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:17:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:57 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 1073741824 Sep 10 20:17:57 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:58 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 1073741824" returned: 0 in 0.752s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:17:58 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 Sep 10 20:17:58 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:17:58 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 10 20:17:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43" returned: 0 in 0.339s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:17:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:17:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:17:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94609b1-ea46-45b5-a6a0-d116ed9e5357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a00b95-01d0-4c5d-ae39-3f010f783d43', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060b1918-a5bc-4879-b60f-3f65a621cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:17:58 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Volume volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 (89a00b95-01d0-4c5d-ae39-3f010f783d43): created successfully Sep 10 20:17:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060b1918-a5bc-4879-b60f-3f65a621cb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:17:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Flow 'volume_create_manager' (bebda2c0-895a-4fa6-aab8-a4b8cbf41f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:17:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e1a8f27a-c63a-4bd9-a431-a187b476216f tempest-AttachVolumeNegativeTest-2145474300 None] Created volume successfully. Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Flow 'volume_create_manager' (e4b59f20-8772-43ec-8760-0c3c7dbcf322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2860b6a8-0bef-4ffb-94db-bae89600e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2860b6a8-0bef-4ffb-94db-bae89600e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2fc48d-a24f-4c14-b245-0afd445b1f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91f1bd8c40f45f59c53f5815438a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:00Z,use_quota=True,user_id='a548ee2c01e64ff6b6f939e14d1df6e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf358a4-53d5-4012-85b7-cd4569e2497f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf358a4-53d5-4012-85b7-cd4569e2497f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5527f3-428b-4e5e-8536-f3a6a0ea9f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-db406f29-584a-47ce-9a1f-c26edf2ffc91 req-7efd80dd-cdef-440c-9693-d786643cfff2 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-db406f29-584a-47ce-9a1f-c26edf2ffc91 req-7efd80dd-cdef-440c-9693-d786643cfff2 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-db406f29-584a-47ce-9a1f-c26edf2ffc91 req-7efd80dd-cdef-440c-9693-d786643cfff2 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-db406f29-584a-47ce-9a1f-c26edf2ffc91 req-7efd80dd-cdef-440c-9693-d786643cfff2 tempest-AttachVolumeNegativeTest-2145474300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-89a00b95-01d0-4c5d-ae39-3f010f783d43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebb82d33-13b6-4e38-b8d6-307c136e2aec', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5527f3-428b-4e5e-8536-f3a6a0ea9f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c2fc48d-a24f-4c14-b245-0afd445b1f09', 'volume_name': 'volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09', 'volume_size': 1, 'image_id': 'e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd789603cc734a94229aaa8e69d6204fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a91f1bd8c40f45f59c53f5815438a3e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7a074f549a2eb284f0fdd4c22ecd45a79f56f51f2076c6097260888bc27a1389e4f43f8f8805fb94ad345400dd4d3c4289ff2dfc8939eb0aac74878b34d64ba', 'id': 'e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'created_at': datetime.datetime(2026, 9, 10, 18, 17, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 17, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6215e06-8d6c-404e-b3d8-424bd32b14c3/file', 'properties': {}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b9b299-4c1d-4edc-8b9a-8cbf75906c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b9b299-4c1d-4edc-8b9a-8cbf75906c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381adc78-39fc-4519-bbd6-1304e38f77ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:01 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Volume 0c2fc48d-a24f-4c14-b245-0afd445b1f09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09', 'volume_size': 1, 'image_id': 'e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd789603cc734a94229aaa8e69d6204fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a91f1bd8c40f45f59c53f5815438a3e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7a074f549a2eb284f0fdd4c22ecd45a79f56f51f2076c6097260888bc27a1389e4f43f8f8805fb94ad345400dd4d3c4289ff2dfc8939eb0aac74878b34d64ba', 'id': 'e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'created_at': datetime.datetime(2026, 9, 10, 18, 17, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 17, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6215e06-8d6c-404e-b3d8-424bd32b14c3/file', 'properties': {}}, 'image_service': } Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Trying to clone 0c2fc48d-a24f-4c14-b245-0afd445b1f09 from image e6215e06-8d6c-404e-b3d8-424bd32b14c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:18:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-db406f29-584a-47ce-9a1f-c26edf2ffc91 req-7efd80dd-cdef-440c-9693-d786643cfff2 tempest-AttachVolumeNegativeTest-2145474300 None] attachment_update completed successfully. Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:18:01 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Image download 0.00 MB at 0.00 MB/s Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae66a615-8f9d-43db-92a8-cee37df2dde3]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:01 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD Sep 10 20:18:01 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:01 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD" returned: 0 in 0.554s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:02 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD Sep 10 20:18:02 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:02 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD" returned: 1 in 0.434s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:18:02 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Temporary image e6215e06-8d6c-404e-b3d8-424bd32b14c3 is fetched for user a548ee2c01e64ff6b6f939e14d1df6e2. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:18:02 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83b4dc9-420c-4644-a821-8c90201d299e]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:02 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD Sep 10 20:18:02 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:02 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:03 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD Sep 10 20:18:03 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:03 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD" returned: 1 in 0.402s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2fc48d-a24f-4c14-b245-0afd445b1f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91f1bd8c40f45f59c53f5815438a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:00Z,use_quota=True,user_id='a548ee2c01e64ff6b6f939e14d1df6e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Creating volume 0c2fc48d-a24f-4c14-b245-0afd445b1f09 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:18:03 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:03 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 1073741824 Sep 10 20:18:03 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:03 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-176d88ac-c0be-4b0d-b3af-479a16be7eee req-945b525e-b75b-4893-ae0a-9307bec5fd50 tempest-AttachVolumeNegativeTest-2145474300 None] Terminate volume connection completed successfully. Sep 10 20:18:03 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-176d88ac-c0be-4b0d-b3af-479a16be7eee req-945b525e-b75b-4893-ae0a-9307bec5fd50 tempest-AttachVolumeNegativeTest-2145474300 None] Deleting attachment ebb82d33-13b6-4e38-b8d6-307c136e2aec. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:18:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 1073741824" returned: 0 in 0.677s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:04 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 Sep 10 20:18:04 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:04 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09" returned: 0 in 0.311s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:18:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:04 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Attempting download of e6215e06-8d6c-404e-b3d8-424bd32b14c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'metadata': {}}])) to volume 0c2fc48d-a24f-4c14-b245-0afd445b1f09. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:18:04 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[691fda07-c751-4dd4-9bbd-40f2a89a80be]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6215e06-8d6c-404e-b3d8-424bd32b14c3_meupzg7w {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:04 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6215e06-8d6c-404e-b3d8-424bd32b14c3_meupzg7w Sep 10 20:18:04 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:05 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6215e06-8d6c-404e-b3d8-424bd32b14c3_meupzg7w" returned: 0 in 0.539s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6215e06-8d6c-404e-b3d8-424bd32b14c3_meupzg7w {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:05 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6215e06-8d6c-404e-b3d8-424bd32b14c3_meupzg7w Sep 10 20:18:05 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:05 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6215e06-8d6c-404e-b3d8-424bd32b14c3_meupzg7w" returned: 1 in 0.474s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6215e06-8d6c-404e-b3d8-424bd32b14c3_meupzg7w' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:18:05 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d48bd2-dcb6-4cec-9330-2e193b301732]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:05 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD Sep 10 20:18:05 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:06 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD" returned: 0 in 0.638s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:06 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD Sep 10 20:18:06 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:06 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD" returned: 1 in 0.569s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:18:06 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] e6215e06-8d6c-404e-b3d8-424bd32b14c3 was raw, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:18:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:06 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 Sep 10 20:18:06 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:07 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09" returned: 0 in 0.667s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:07 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e6215e06-8d6c-404e-b3d8-424bd32b14c3_j6dowxx_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:18:07 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 20:18:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:07 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 1G Sep 10 20:18:07 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:07 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 1G" returned: 0 in 0.537s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:07 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Downloaded image e6215e06-8d6c-404e-b3d8-424bd32b14c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'metadata': {}}])) to volume 0c2fc48d-a24f-4c14-b245-0afd445b1f09 successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:18:07 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Temporary image e6215e06-8d6c-404e-b3d8-424bd32b14c3 for user a548ee2c01e64ff6b6f939e14d1df6e2 is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:18:07 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Marking volume 0c2fc48d-a24f-4c14-b245-0afd445b1f09 as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:18:07 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Copying metadata from image e6215e06-8d6c-404e-b3d8-424bd32b14c3 to 0c2fc48d-a24f-4c14-b245-0afd445b1f09. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:18:07 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Creating volume glance metadata for volume 0c2fc48d-a24f-4c14-b245-0afd445b1f09 backed by image e6215e06-8d6c-404e-b3d8-424bd32b14c3 with: {'image_id': 'e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd789603cc734a94229aaa8e69d6204fc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:18:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381adc78-39fc-4519-bbd6-1304e38f77ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09', 'volume_size': 1, 'image_id': 'e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd789603cc734a94229aaa8e69d6204fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a91f1bd8c40f45f59c53f5815438a3e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7a074f549a2eb284f0fdd4c22ecd45a79f56f51f2076c6097260888bc27a1389e4f43f8f8805fb94ad345400dd4d3c4289ff2dfc8939eb0aac74878b34d64ba', 'id': 'e6215e06-8d6c-404e-b3d8-424bd32b14c3', 'created_at': datetime.datetime(2026, 9, 10, 18, 17, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 17, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6215e06-8d6c-404e-b3d8-424bd32b14c3/file', 'properties': {}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e030956-0468-421a-895d-1147bf260612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:08 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Volume volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 (0c2fc48d-a24f-4c14-b245-0afd445b1f09): created successfully Sep 10 20:18:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e030956-0468-421a-895d-1147bf260612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Flow 'volume_create_manager' (e4b59f20-8772-43ec-8760-0c3c7dbcf322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:08 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c971ef3e-2d24-4a8f-81d5-456862ec98c7 tempest-VolumeImageDependencyTests-756885888 None] Created volume successfully. Sep 10 20:18:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Acquiring lock "cinder-0c2fc48d-a24f-4c14-b245-0afd445b1f09-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Lock "cinder-0c2fc48d-a24f-4c14-b245-0afd445b1f09-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Acquiring lock "cinder-quobyte-0c2fc48d-a24f-4c14-b245-0afd445b1f09" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Lock "cinder-quobyte-0c2fc48d-a24f-4c14-b245-0afd445b1f09" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbbab15-9df5-4acf-b981-aed90309a3c1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:09 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 Sep 10 20:18:09 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:10 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09" returned: 0 in 0.528s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:10 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09 Sep 10 20:18:10 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:10 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0c2fc48d-a24f-4c14-b245-0afd445b1f09" returned: 0 in 0.339s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Lock "cinder-quobyte-0c2fc48d-a24f-4c14-b245-0afd445b1f09" released by "delete_volume" :: held 0.944s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Created reservations ['e6a596cf-a277-492e-9821-805bbf582254', '20b34a39-0968-4adf-a792-23f7c9ee0b33', '2ad0782e-2007-489b-97d3-eb19d90203eb', '15fea436-a451-4617-8cd6-360d840ca64a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "cinder-89a00b95-01d0-4c5d-ae39-3f010f783d43-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-89a00b95-01d0-4c5d-ae39-3f010f783d43-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "cinder-quobyte-89a00b95-01d0-4c5d-ae39-3f010f783d43" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-quobyte-89a00b95-01d0-4c5d-ae39-3f010f783d43" acquired by "delete_volume" :: waited 0.036s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acf2f67-48e9-4d2f-bb7c-29b7ee4ed73b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:10 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:18:10 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:10 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 Sep 10 20:18:10 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:11 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.363s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:18:11 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Deleted volume successfully. Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-21d60960-7917-44f7-a2e8-e9a475cddea3 tempest-VolumeImageDependencyTests-756885888 None] Lock "cinder-0c2fc48d-a24f-4c14-b245-0afd445b1f09-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:11 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43" returned: 0 in 0.498s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:11 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43 Sep 10 20:18:11 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:11 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-89a00b95-01d0-4c5d-ae39-3f010f783d43" returned: 0 in 0.313s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-quobyte-89a00b95-01d0-4c5d-ae39-3f010f783d43" released by "delete_volume" :: held 0.918s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Created reservations ['c0a6a8b0-46e5-41ae-a66e-cc02ef55a7bd', '9cc5d911-bc68-427c-9da3-ea9e9d7d5fca', '7dc31d3c-a668-4d11-a72d-ad69a7bf57c5', 'dc40594b-4d0e-4d58-bcdd-2666d796f44b'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:12 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:18:12 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:12 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.291s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:12 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:18:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Deleted volume successfully. Sep 10 20:18:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8cb8e049-74a2-4c20-9c8f-524138af94e1 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-89a00b95-01d0-4c5d-ae39-3f010f783d43-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "cinder-1b8a281b-3c8b-464b-8072-3d8e5ed02b40-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-1b8a281b-3c8b-464b-8072-3d8e5ed02b40-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "cinder-quobyte-1b8a281b-3c8b-464b-8072-3d8e5ed02b40" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-quobyte-1b8a281b-3c8b-464b-8072-3d8e5ed02b40" acquired by "delete_volume" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:13 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c53710d-f123-44a5-a63c-1ca22e162106]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:13 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 Sep 10 20:18:13 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:13 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40" returned: 0 in 0.464s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:13 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40 Sep 10 20:18:13 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:14 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1b8a281b-3c8b-464b-8072-3d8e5ed02b40" returned: 0 in 0.364s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-quobyte-1b8a281b-3c8b-464b-8072-3d8e5ed02b40" released by "delete_volume" :: held 0.898s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Created reservations ['1adfa860-50b7-45f9-93d1-d63e47bca9f3', 'f29a0572-8b28-4719-9389-329ce2cf00d6', '53a17930-67bd-47c6-90fa-90522380e346', '22cb33e6-32f1-495e-95ba-827c74bd02df'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:14 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:18:14 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "cinder-2ef0c087-3f79-426c-b9a4-df9d935c2c62-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-2ef0c087-3f79-426c-b9a4-df9d935c2c62-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "cinder-quobyte-2ef0c087-3f79-426c-b9a4-df9d935c2c62" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:14 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.539s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:18:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Deleted volume successfully. Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-quobyte-2ef0c087-3f79-426c-b9a4-df9d935c2c62" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5f2ca3b0-3a59-4919-bc5a-f826c1762d80 tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-1b8a281b-3c8b-464b-8072-3d8e5ed02b40-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe785ff-6c60-4554-a35f-6d29772f8c8c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:15 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 Sep 10 20:18:15 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:15 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62" returned: 0 in 0.479s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:15 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62 Sep 10 20:18:15 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:15 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2ef0c087-3f79-426c-b9a4-df9d935c2c62" returned: 0 in 0.333s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-quobyte-2ef0c087-3f79-426c-b9a4-df9d935c2c62" released by "delete_volume" :: held 0.877s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Created reservations ['41583e4a-9822-42bd-ad7e-3f40ac5b5836', '61008832-7bfa-4f83-9357-c4ee9ff5106f', '26293d04-bc60-4043-84a6-3c1df51c220e', 'b417cf72-d1fd-4cca-83ae-652c3d8f5f14'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:15 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:18:15 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:16 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.332s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:18:16 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Deleted volume successfully. Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-18696151-57b7-437c-8aff-aa5f7e091afa tempest-AttachVolumeNegativeTest-2145474300 None] Lock "cinder-2ef0c087-3f79-426c-b9a4-df9d935c2c62-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Flow 'volume_create_manager' (b54a7bf6-0ee5-4a7f-8906-20d180caa1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620f50d9-98be-428e-b084-3ef57fdd148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620f50d9-98be-428e-b084-3ef57fdd148c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbd3d0d-1977-414a-959f-1d0cb5dfdce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3b34f661e342f783f5cc9e188ee34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:17Z,use_quota=True,user_id='50c213789363445ea59565b52c154b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760861dd-89ac-46f2-9bcc-f37e3f457ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760861dd-89ac-46f2-9bcc-f37e3f457ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c13f8a-813d-4852-974c-26bda2963c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c13f8a-813d-4852-974c-26bda2963c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dbd3d0d-1977-414a-959f-1d0cb5dfdce0', 'volume_name': 'volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71faceb4-258a-46b5-bf61-c4b51405259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71faceb4-258a-46b5-bf61-c4b51405259b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9dccc5-e514-4b48-b69b-ee496d2e4745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:16 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Volume 8dbd3d0d-1977-414a-959f-1d0cb5dfdce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0', 'volume_size': 1} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbd3d0d-1977-414a-959f-1d0cb5dfdce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3b34f661e342f783f5cc9e188ee34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:17Z,use_quota=True,user_id='50c213789363445ea59565b52c154b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Creating volume 8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:18:16 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:18:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:16 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 1073741824 Sep 10 20:18:16 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:17 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 1073741824" returned: 0 in 0.593s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:17 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 Sep 10 20:18:17 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:17 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0" returned: 0 in 0.323s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:18:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9dccc5-e514-4b48-b69b-ee496d2e4745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f236a310-f209-42d3-9834-c121430fb1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:17 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Volume volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 (8dbd3d0d-1977-414a-959f-1d0cb5dfdce0): created successfully Sep 10 20:18:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f236a310-f209-42d3-9834-c121430fb1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Flow 'volume_create_manager' (b54a7bf6-0ee5-4a7f-8906-20d180caa1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0b81800b-8ac7-41ef-88ce-e5c6379af3c2 tempest-CinderUnicodeTest-2001920559 None] Created volume successfully. Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Flow 'volume_create_manager' (a8e7e94f-5f2c-4ce3-8a40-b81effdbc288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8614827-0276-4233-9590-4cb458328f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8614827-0276-4233-9590-4cb458328f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-537117157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab7282c-23a2-44be-805a-997fcdb9d623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3b34f661e342f783f5cc9e188ee34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:20Z,use_quota=True,user_id='50c213789363445ea59565b52c154b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a21ba2-1d8c-40eb-bf6d-0b6c72a4af6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a21ba2-1d8c-40eb-bf6d-0b6c72a4af6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1004a904-0349-4a0f-a83b-e7b667ba306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1004a904-0349-4a0f-a83b-e7b667ba306b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab7282c-23a2-44be-805a-997fcdb9d623', 'volume_name': 'volume-cab7282c-23a2-44be-805a-997fcdb9d623', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07105c46-05f8-4238-ac39-afad4cad9597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07105c46-05f8-4238-ac39-afad4cad9597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1293c8f-af9c-409c-9a2c-b37f44a47efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Volume cab7282c-23a2-44be-805a-997fcdb9d623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab7282c-23a2-44be-805a-997fcdb9d623', 'volume_size': 1} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-537117157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab7282c-23a2-44be-805a-997fcdb9d623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3b34f661e342f783f5cc9e188ee34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:20Z,use_quota=True,user_id='50c213789363445ea59565b52c154b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Creating volume cab7282c-23a2-44be-805a-997fcdb9d623 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:18:19 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:18:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:19 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 1073741824 Sep 10 20:18:19 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:20 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 1073741824" returned: 0 in 0.526s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:20 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 Sep 10 20:18:20 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:20 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:18:20 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:20 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1293c8f-af9c-409c-9a2c-b37f44a47efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab7282c-23a2-44be-805a-997fcdb9d623', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf1dbc2-67b4-45ab-be0c-3707e68b0dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:20 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Volume volume-cab7282c-23a2-44be-805a-997fcdb9d623 (cab7282c-23a2-44be-805a-997fcdb9d623): created successfully Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf1dbc2-67b4-45ab-be0c-3707e68b0dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Flow 'volume_create_manager' (a8e7e94f-5f2c-4ce3-8a40-b81effdbc288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:20 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5bef6108-8f3a-4464-a346-71d85478b9ce tempest-CinderUnicodeTest-2001920559 None] Created volume successfully. Sep 10 20:18:20 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.374s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:18:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:18:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Creating offline snapshot 8e766f24-a261-48cc-98d5-69b92f22bfb7 of volume cab7282c-23a2-44be-805a-997fcdb9d623 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:18:22 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[18673aeb-9add-46ce-879a-d8de8f7858bc]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:22 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 Sep 10 20:18:22 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:22 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623" returned: 0 in 0.453s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:22 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 1G Sep 10 20:18:22 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:23 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 1G" returned: 0 in 0.540s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab7282c-23a2-44be-805a-997fcdb9d623 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:23 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab7282c-23a2-44be-805a-997fcdb9d623 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 Sep 10 20:18:23 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:23 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cab7282c-23a2-44be-805a-997fcdb9d623 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7" returned: 0 in 0.363s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:23 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 is being set with open permissions: ugo+rw Sep 10 20:18:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:23 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 Sep 10 20:18:23 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:23 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7" returned: 0 in 0.283s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:23 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.info Sep 10 20:18:23 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:24 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.info" returned: 0 in 0.439s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:24 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.info is being set with open permissions: ugo+rw Sep 10 20:18:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:24 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.info Sep 10 20:18:24 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:24 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.info" returned: 0 in 0.349s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:24 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-664076f4-8864-4901-aa9f-06227757395e tempest-CinderUnicodeTest-2001920559 None] Create snapshot completed successfully Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "cinder-8e766f24-a261-48cc-98d5-69b92f22bfb7-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-8e766f24-a261-48cc-98d5-69b92f22bfb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "cinder-quobyte-cab7282c-23a2-44be-805a-997fcdb9d623" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-quobyte-cab7282c-23a2-44be-805a-997fcdb9d623" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "cinder-quobyte-8e766f24-a261-48cc-98d5-69b92f22bfb7" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-quobyte-8e766f24-a261-48cc-98d5-69b92f22bfb7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Deleting offline snapshot 8e766f24-a261-48cc-98d5-69b92f22bfb7 of volume cab7282c-23a2-44be-805a-997fcdb9d623 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] snapshot_file for this snap is: volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e584e8-75d1-4c3e-91d1-a6c80cf1deb8]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:25 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 Sep 10 20:18:25 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:25 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7" returned: 0 in 0.400s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cab7282c-23a2-44be-805a-997fcdb9d623(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21a2c8d-ed07-4a64-b5c7-d97f0fdb4321]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:26 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 Sep 10 20:18:26 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:26 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623" returned: 0 in 0.443s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:26 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 Sep 10 20:18:26 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:26 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7" returned: 0 in 0.466s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:26 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7 Sep 10 20:18:26 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:27 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623.8e766f24-a261-48cc-98d5-69b92f22bfb7" returned: 0 in 0.291s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-quobyte-8e766f24-a261-48cc-98d5-69b92f22bfb7" released by "_delete_snapshot" :: held 1.742s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-quobyte-cab7282c-23a2-44be-805a-997fcdb9d623" released by "delete_snapshot" :: held 1.780s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Created reservations ['6046d4c8-7d89-4fcd-8860-572f39241600', 'b16179bf-64b7-4f3b-9f91-529025f3337d', 'f7ab6a56-28a2-49c7-bf48-35cf4329e4c8', '43b0c3c1-f295-4133-82da-56c798e57dad'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Delete snapshot completed successfully. Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-799a7156-ec45-4894-9d5c-773463a630e7 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-8e766f24-a261-48cc-98d5-69b92f22bfb7-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "cinder-cab7282c-23a2-44be-805a-997fcdb9d623-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-cab7282c-23a2-44be-805a-997fcdb9d623-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "cinder-quobyte-cab7282c-23a2-44be-805a-997fcdb9d623" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-quobyte-cab7282c-23a2-44be-805a-997fcdb9d623" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21d88ac-23c1-46c8-afcc-1306f26f8bf3]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:27 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 Sep 10 20:18:27 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:28 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623" returned: 0 in 0.428s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:28 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623 Sep 10 20:18:28 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:28 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cab7282c-23a2-44be-805a-997fcdb9d623" returned: 0 in 0.282s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-quobyte-cab7282c-23a2-44be-805a-997fcdb9d623" released by "delete_volume" :: held 0.777s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Created reservations ['0deb226e-3381-4f65-bb89-34f36c4a711a', '19f66367-6286-4e0a-bbf9-8e62d9fae741', 'aa9f2817-7a0d-4b62-ac7a-f04e0a6812d1', '64e59403-fe9c-48d9-b80c-d4fd0a44cef6'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:28 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:18:28 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "cinder-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:28 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.296s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "cinder-quobyte-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Deleted volume successfully. Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-quobyte-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-02c255c5-f50b-44d8-8ec4-4fddc802ed8b tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-cab7282c-23a2-44be-805a-997fcdb9d623-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:29 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5117c594-e4c7-47de-a9e0-1767b3ecce4e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:29 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 Sep 10 20:18:29 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:29 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0" returned: 0 in 0.430s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:29 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0 Sep 10 20:18:29 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:29 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0" returned: 0 in 0.362s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-quobyte-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0" released by "delete_volume" :: held 0.846s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:29 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Created reservations ['5dd817a6-cad2-4489-96a9-5d7235a33a51', '03180e00-13af-4f2a-a011-b9452f292fc9', '67b3505b-a8df-4f32-9520-6ecb7a6c2115', '48a0c1a1-635c-48e5-9296-eccb8d8a4dd6'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:30 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:18:30 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2a406e43-ac31-4dfa-bed7-21dc4160e760 tempest-GroupSnapshotsV319Test-314939328 None] Group tempest-GroupSnapshotsV319Test-Group-189188169: creating Sep 10 20:18:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2a406e43-ac31-4dfa-bed7-21dc4160e760 tempest-GroupSnapshotsV319Test-314939328 None] Group tempest-GroupSnapshotsV319Test-Group-189188169: created successfully Sep 10 20:18:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2a406e43-ac31-4dfa-bed7-21dc4160e760 tempest-GroupSnapshotsV319Test-314939328 None] Create group completed successfully. Sep 10 20:18:30 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.306s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:30 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:18:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Deleted volume successfully. Sep 10 20:18:30 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c8d30282-2759-49a6-8f96-a469995507a8 tempest-CinderUnicodeTest-2001920559 None] Lock "cinder-8dbd3d0d-1977-414a-959f-1d0cb5dfdce0-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:31 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:18:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Flow 'volume_create_manager' (5af1914c-b4ef-4c8d-a8cf-3ca2b73f48f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2375f4-257a-461f-a2fe-5c3edc6f187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2375f4-257a-461f-a2fe-5c3edc6f187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-100886401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ebeeff0-cf1d-4d0a-928d-d4f7f6c2ae0f,host='devstack@QuobyteHD#QuobyteHD',id=b211b0af-8a13-4cea-bde0-f130acb0889e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1258d9c0a146490cac154ad54e37ee1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:32Z,use_quota=True,user_id='04d659133ada4efeba5387e397429e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80821d06-518f-4f44-9079-6a54c9df1a9e),volume_type_id=80821d06-518f-4f44-9079-6a54c9df1a9e)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2373ad-9586-4bfa-8bdb-c86c105c90dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2373ad-9586-4bfa-8bdb-c86c105c90dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836ec5ec-09a5-4e4d-844d-666a13282aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836ec5ec-09a5-4e4d-844d-666a13282aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b211b0af-8a13-4cea-bde0-f130acb0889e', 'volume_name': 'volume-b211b0af-8a13-4cea-bde0-f130acb0889e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f96c6e-e103-4bfb-8380-a30abb1dc505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f96c6e-e103-4bfb-8380-a30abb1dc505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32853e8c-6859-4db3-a3ca-62d02837fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Volume b211b0af-8a13-4cea-bde0-f130acb0889e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b211b0af-8a13-4cea-bde0-f130acb0889e', 'volume_size': 1} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ebeeff0-cf1d-4d0a-928d-d4f7f6c2ae0f,created_at=2026-09-10T18:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-100886401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ebeeff0-cf1d-4d0a-928d-d4f7f6c2ae0f,host='devstack@QuobyteHD#QuobyteHD',id=b211b0af-8a13-4cea-bde0-f130acb0889e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1258d9c0a146490cac154ad54e37ee1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:32Z,use_quota=True,user_id='04d659133ada4efeba5387e397429e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80821d06-518f-4f44-9079-6a54c9df1a9e),volume_type_id=80821d06-518f-4f44-9079-6a54c9df1a9e)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Creating volume b211b0af-8a13-4cea-bde0-f130acb0889e {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:18:32 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:32 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e 1073741824 Sep 10 20:18:32 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:32 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e 1073741824" returned: 0 in 0.526s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:32 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e Sep 10 20:18:32 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e" returned: 0 in 0.251s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:32 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32853e8c-6859-4db3-a3ca-62d02837fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b211b0af-8a13-4cea-bde0-f130acb0889e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a2256-c24d-468c-ba0a-96f02f70b2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Volume volume-b211b0af-8a13-4cea-bde0-f130acb0889e (b211b0af-8a13-4cea-bde0-f130acb0889e): created successfully Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a2256-c24d-468c-ba0a-96f02f70b2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Flow 'volume_create_manager' (5af1914c-b4ef-4c8d-a8cf-3ca2b73f48f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-79b8396d-2c51-4f95-9e3b-3d9aad6f27af tempest-GroupSnapshotsV319Test-314939328 None] Created volume successfully. Sep 10 20:18:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] GroupSnapshot 614a270c-68f6-4074-9145-feb30adca90c: creating. Sep 10 20:18:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Group snapshot 614a270c-68f6-4074-9145-feb30adca90c: creating. {{(pid=88137) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 20:18:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Creating offline snapshot de404393-d07b-4c5e-b50c-bea2a599a463 of volume b211b0af-8a13-4cea-bde0-f130acb0889e {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:18:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9799b313-516f-462a-b510-8001c44833a2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:34 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e Sep 10 20:18:34 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:34 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e" returned: 0 in 0.438s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:34 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 1G Sep 10 20:18:34 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:34 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 1G" returned: 0 in 0.409s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b211b0af-8a13-4cea-bde0-f130acb0889e -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:34 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b211b0af-8a13-4cea-bde0-f130acb0889e -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 Sep 10 20:18:34 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:35 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b211b0af-8a13-4cea-bde0-f130acb0889e -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463" returned: 0 in 0.360s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:35 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:18:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:35 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 Sep 10 20:18:35 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:35 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463" returned: 0 in 0.297s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:35 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.info Sep 10 20:18:35 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:35 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.info" returned: 0 in 0.267s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:35 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 20:18:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:35 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.info Sep 10 20:18:35 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:35 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.info" returned: 0 in 0.295s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-da3cd04d-4e01-460d-8093-c8fbdc7fe8ed tempest-GroupSnapshotsV319Test-314939328 None] group_snapshot 614a270c-68f6-4074-9145-feb30adca90c: created successfully Sep 10 20:18:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] group_snapshot 614a270c-68f6-4074-9145-feb30adca90c: deleting Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] group_snapshot 614a270c-68f6-4074-9145-feb30adca90c: deleting {{(pid=88137) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Acquiring lock "cinder-quobyte-b211b0af-8a13-4cea-bde0-f130acb0889e" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Lock "cinder-quobyte-b211b0af-8a13-4cea-bde0-f130acb0889e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Acquiring lock "cinder-quobyte-de404393-d07b-4c5e-b50c-bea2a599a463" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Lock "cinder-quobyte-de404393-d07b-4c5e-b50c-bea2a599a463" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Deleting offline snapshot de404393-d07b-4c5e-b50c-bea2a599a463 of volume b211b0af-8a13-4cea-bde0-f130acb0889e {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] snapshot_file for this snap is: volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab16acec-10f9-4b16-8ba3-1634f29a0473]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:37 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 Sep 10 20:18:37 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:37 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463" returned: 0 in 0.377s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b211b0af-8a13-4cea-bde0-f130acb0889e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:18:38 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c4447e-6573-4394-9ba0-274bdd85a02e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:38 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e Sep 10 20:18:38 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:38 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e" returned: 0 in 0.359s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:38 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 Sep 10 20:18:38 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:38 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463" returned: 0 in 0.321s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:38 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463 Sep 10 20:18:38 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:38 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e.de404393-d07b-4c5e-b50c-bea2a599a463" returned: 0 in 0.250s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Lock "cinder-quobyte-de404393-d07b-4c5e-b50c-bea2a599a463" released by "_delete_snapshot" :: held 1.428s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Lock "cinder-quobyte-b211b0af-8a13-4cea-bde0-f130acb0889e" released by "delete_snapshot" :: held 1.453s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:39 devstack cinder-volume[88137]: WARNING cinder.quota [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1460430524 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1460430524, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:18:39 devstack cinder-volume[88137]: WARNING cinder.quota [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1460430524 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1460430524, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:18:39 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] Created reservations ['479a7bb1-ec31-42d0-aa15-f69b8439b2c9', '79b982bc-f317-466d-ba49-53508315602f', '003bf861-a859-4bcf-a38e-07d5029eea24', '72e9da6d-1eb6-4a79-a6b3-49f2315a35e5'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4f82c37e-7677-4eba-9463-ae698766c10d tempest-GroupSnapshotsV319Test-314939328 None] group_snapshot 614a270c-68f6-4074-9145-feb30adca90c: deleted successfully Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Acquiring lock "cinder-quobyte-b211b0af-8a13-4cea-bde0-f130acb0889e" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Lock "cinder-quobyte-b211b0af-8a13-4cea-bde0-f130acb0889e" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3247a0-97a7-4463-b06f-160de0c19645]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:40 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e Sep 10 20:18:40 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:40 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e" returned: 0 in 0.366s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:40 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e Sep 10 20:18:40 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:40 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b211b0af-8a13-4cea-bde0-f130acb0889e" returned: 0 in 0.257s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Lock "cinder-quobyte-b211b0af-8a13-4cea-bde0-f130acb0889e" released by "delete_volume" :: held 0.681s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Created reservations ['415b9515-313a-4ff3-a2a5-c9443b1d71bd'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:40 devstack cinder-volume[88137]: WARNING cinder.quota [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1460430524 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1460430524, it is now deprecated. Please use the default quota class for default quota. Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Created reservations ['b648bb8d-a250-4c8f-993e-7ab5ea586a17', '30d89524-a65f-49e4-be3d-15a91e8f1708', '3ee273ad-3152-46e2-bc9d-8d7b92113719', '6e9ede3f-31d2-45e0-ae8b-8f85c139fe78'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:40 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:18:40 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:41 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.248s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:41 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:18:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-95477b64-4df0-4d65-b059-f9f4a087d08d tempest-GroupSnapshotsV319Test-314939328 None] Delete group completed successfully. Sep 10 20:18:50 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=81,cinder:INSERT=23,cinder:UPDATE=89,cinder:DELETE=6 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:18:50 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=87,cinder:UPDATE=96,cinder:INSERT=30,cinder:DELETE=6 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Flow 'volume_create_manager' (b7cc93b1-b7c8-4175-afd9-a06763679d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962978ab-c8ed-4d02-89df-0985bc6b2071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962978ab-c8ed-4d02-89df-0985bc6b2071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-693678323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e55d1c1-5227-4874-bc3d-83ca3ec8c668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ea7b95a58a42f5b246551653c43e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:58Z,use_quota=True,user_id='f7c031295eba4c5195a2d97d2a680deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6081c341-b85e-48cd-a9ea-5a395b2fa91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6081c341-b85e-48cd-a9ea-5a395b2fa91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6c6f14-1920-4e15-87cf-90ac032b913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6c6f14-1920-4e15-87cf-90ac032b913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e55d1c1-5227-4874-bc3d-83ca3ec8c668', 'volume_name': 'volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34712a02-94b4-4525-a358-0e2507aece85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34712a02-94b4-4525-a358-0e2507aece85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1a3ea8-3722-4e10-9c55-fe0eb4be1c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:57 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Volume 7e55d1c1-5227-4874-bc3d-83ca3ec8c668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668', 'volume_size': 1} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-693678323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e55d1c1-5227-4874-bc3d-83ca3ec8c668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ea7b95a58a42f5b246551653c43e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:58Z,use_quota=True,user_id='f7c031295eba4c5195a2d97d2a680deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Creating volume 7e55d1c1-5227-4874-bc3d-83ca3ec8c668 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:18:57 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:18:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:57 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 1073741824 Sep 10 20:18:57 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Flow 'volume_create_manager' (ca23e5fc-daa6-4526-8c9e-ee59719a1ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb654b6d-e762-4650-b7c0-abb5d8ff8521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb654b6d-e762-4650-b7c0-abb5d8ff8521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-826164045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88edb449-bdb1-4c26-b41f-6b58126485f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943474a65c1e4f638eaa5fb8593d4e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:58Z,use_quota=True,user_id='19b76809cf304fe791b09f455a1bcc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bee74b-03bd-4690-a22a-2395f9974c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83bee74b-03bd-4690-a22a-2395f9974c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bcdd28-3a7e-4dba-bcd5-e0c19be67a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bcdd28-3a7e-4dba-bcd5-e0c19be67a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88edb449-bdb1-4c26-b41f-6b58126485f3', 'volume_name': 'volume-88edb449-bdb1-4c26-b41f-6b58126485f3', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a2483e-5f54-4d2b-90b6-410d9ec3f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a2483e-5f54-4d2b-90b6-410d9ec3f36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b907c89-ffec-4b5e-b2ee-f33d4693b7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:58 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Volume 88edb449-bdb1-4c26-b41f-6b58126485f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88edb449-bdb1-4c26-b41f-6b58126485f3', 'volume_size': 1} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:58 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 1073741824" returned: 0 in 0.467s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:58 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 Sep 10 20:18:58 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:58 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668" returned: 0 in 0.241s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-826164045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88edb449-bdb1-4c26-b41f-6b58126485f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943474a65c1e4f638eaa5fb8593d4e68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:18:58Z,use_quota=True,user_id='19b76809cf304fe791b09f455a1bcc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Creating volume 88edb449-bdb1-4c26-b41f-6b58126485f3 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:18:58 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:58 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3 1073741824 Sep 10 20:18:58 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1a3ea8-3722-4e10-9c55-fe0eb4be1c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f700b49a-5312-40d4-a270-9aa7ce1e1ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:58 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Volume volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 (7e55d1c1-5227-4874-bc3d-83ca3ec8c668): created successfully Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f700b49a-5312-40d4-a270-9aa7ce1e1ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Flow 'volume_create_manager' (b7cc93b1-b7c8-4175-afd9-a06763679d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5e050213-097b-47b6-8e34-777b31124665 tempest-VolumesServicesTestJSON-2019101302 None] Created volume successfully. Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Acquiring lock "cinder-7e55d1c1-5227-4874-bc3d-83ca3ec8c668-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Lock "cinder-7e55d1c1-5227-4874-bc3d-83ca3ec8c668-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Acquiring lock "cinder-quobyte-7e55d1c1-5227-4874-bc3d-83ca3ec8c668" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Lock "cinder-quobyte-7e55d1c1-5227-4874-bc3d-83ca3ec8c668" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9eab40-cf9e-4f47-905d-1fbc4249892f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:59 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3 1073741824" returned: 0 in 0.505s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:59 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3 Sep 10 20:18:59 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:59 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 Sep 10 20:18:59 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:59 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3" returned: 0 in 0.264s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b907c89-ffec-4b5e-b2ee-f33d4693b7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88edb449-bdb1-4c26-b41f-6b58126485f3', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40356e57-4a13-4113-9021-31f913cf62bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:18:59 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:59 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Volume volume-88edb449-bdb1-4c26-b41f-6b58126485f3 (88edb449-bdb1-4c26-b41f-6b58126485f3): created successfully Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40356e57-4a13-4113-9021-31f913cf62bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Flow 'volume_create_manager' (ca23e5fc-daa6-4526-8c9e-ee59719a1ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668" returned: 0 in 0.377s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-bbac8b68-9e82-4d72-befb-6f6995c5a623 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Created volume successfully. Sep 10 20:18:59 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668 Sep 10 20:18:59 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:18:59 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7e55d1c1-5227-4874-bc3d-83ca3ec8c668" returned: 0 in 0.236s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Lock "cinder-quobyte-7e55d1c1-5227-4874-bc3d-83ca3ec8c668" released by "delete_volume" :: held 0.653s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Created reservations ['42005e24-bbdc-48f5-b6fd-f24865f9b1f4', 'c678d469-c110-4e50-8e19-652e7923b213', '3d423ba2-6a5f-4813-8348-c061e9eca7b1', '65b52297-d7e8-4948-8e97-b7ae8321cc5c'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:18:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:18:59 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:18:59 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:00 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.240s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:00 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:00 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Deleted volume successfully. Sep 10 20:19:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-77f2b3f3-e645-49ff-bf4d-5b36964eef5d tempest-VolumesServicesTestJSON-2019101302 None] Lock "cinder-7e55d1c1-5227-4874-bc3d-83ca3ec8c668-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-c9f6689d-640c-4f8e-98ef-85af0423628c req-02189865-d99a-4cc6-aa57-ccab52bf6b2f tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-c9f6689d-640c-4f8e-98ef-85af0423628c req-02189865-d99a-4cc6-aa57-ccab52bf6b2f tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-c9f6689d-640c-4f8e-98ef-85af0423628c req-02189865-d99a-4cc6-aa57-ccab52bf6b2f tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-c9f6689d-640c-4f8e-98ef-85af0423628c req-02189865-d99a-4cc6-aa57-ccab52bf6b2f tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-88edb449-bdb1-4c26-b41f-6b58126485f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94608bdd-cb17-4cb2-a5e2-b550326cbd93', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:19:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-c9f6689d-640c-4f8e-98ef-85af0423628c req-02189865-d99a-4cc6-aa57-ccab52bf6b2f tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] attachment_update completed successfully. Sep 10 20:19:03 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-8e71b14b-3a23-4869-b67f-20c0f7e6043c req-9df678d5-78d3-40a8-809e-f5590ab95121 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Terminate volume connection completed successfully. Sep 10 20:19:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-8e71b14b-3a23-4869-b67f-20c0f7e6043c req-9df678d5-78d3-40a8-809e-f5590ab95121 tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Deleting attachment 94608bdd-cb17-4cb2-a5e2-b550326cbd93. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:19:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Acquiring lock "cinder-88edb449-bdb1-4c26-b41f-6b58126485f3-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "cinder-88edb449-bdb1-4c26-b41f-6b58126485f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Acquiring lock "cinder-quobyte-88edb449-bdb1-4c26-b41f-6b58126485f3" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "cinder-quobyte-88edb449-bdb1-4c26-b41f-6b58126485f3" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:04 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e357b0d7-d2d9-4d2f-bf15-3cf0a0cf7168]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:04 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3 Sep 10 20:19:04 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:05 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3" returned: 0 in 0.369s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:05 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3 Sep 10 20:19:05 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:05 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-88edb449-bdb1-4c26-b41f-6b58126485f3" returned: 0 in 0.255s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "cinder-quobyte-88edb449-bdb1-4c26-b41f-6b58126485f3" released by "delete_volume" :: held 0.669s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Created reservations ['247268e2-bd1c-49ef-b54b-89689b3d019c', '2f99ecb3-8141-4cf4-9cfc-dc3f098e9a84', '7183ff3d-a312-4af2-9dc9-9f79a9384573', 'cdc68192-9867-43df-ad2e-58d5725d91f9'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:05 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:05 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:05 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:05 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Deleted volume successfully. Sep 10 20:19:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbc897ff-e97e-4f92-b247-098e0c3635ca tempest-TestServerVolumeAttachScenarioOldVersion-1388980507 None] Lock "cinder-88edb449-bdb1-4c26-b41f-6b58126485f3-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Flow 'volume_create_manager' (8b053229-4fe7-42a5-9cad-576e3795792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e33f0c-f8e6-4393-9667-1500ef93fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e33f0c-f8e6-4393-9667-1500ef93fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-609091710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b6c81d-d032-49b6-9905-1ed7dab89d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10de2191638f4b12807f8ca0312de89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:06Z,use_quota=True,user_id='21294e588e67488699ade0647003fae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bb588a-6105-41a3-81fd-79f052a4c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bb588a-6105-41a3-81fd-79f052a4c00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7218a215-ea4a-4260-b499-a093c07e278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7218a215-ea4a-4260-b499-a093c07e278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b6c81d-d032-49b6-9905-1ed7dab89d87', 'volume_name': 'volume-72b6c81d-d032-49b6-9905-1ed7dab89d87', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0c7a79-82ae-46d5-8030-5d41ca543264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0c7a79-82ae-46d5-8030-5d41ca543264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d47657-e754-48d5-b9d9-4048a1cdf281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:06 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Volume 72b6c81d-d032-49b6-9905-1ed7dab89d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b6c81d-d032-49b6-9905-1ed7dab89d87', 'volume_size': 1} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-609091710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b6c81d-d032-49b6-9905-1ed7dab89d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10de2191638f4b12807f8ca0312de89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:06Z,use_quota=True,user_id='21294e588e67488699ade0647003fae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Creating volume 72b6c81d-d032-49b6-9905-1ed7dab89d87 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:06 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:06 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 1073741824 Sep 10 20:19:06 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:07 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 1073741824" returned: 0 in 0.492s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:07 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 Sep 10 20:19:07 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:07 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87" returned: 0 in 0.297s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d47657-e754-48d5-b9d9-4048a1cdf281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b6c81d-d032-49b6-9905-1ed7dab89d87', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c814387a-667a-4a42-8a65-3462c9e6f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:07 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Volume volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 (72b6c81d-d032-49b6-9905-1ed7dab89d87): created successfully Sep 10 20:19:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c814387a-667a-4a42-8a65-3462c9e6f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Flow 'volume_create_manager' (8b053229-4fe7-42a5-9cad-576e3795792b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-08205950-25c3-4bf3-ab76-2076017ec6f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Created volume successfully. Sep 10 20:19:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Creating offline snapshot e9e38172-25f0-4bae-9aae-5d47dd5d22d8 of volume 72b6c81d-d032-49b6-9905-1ed7dab89d87 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:19:08 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[09430dfb-4e2a-4cfb-9f5b-5c71ddb63ae3]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:08 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 Sep 10 20:19:08 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:08 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87" returned: 0 in 0.397s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:09 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 1G Sep 10 20:19:09 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:09 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 1G" returned: 0 in 0.410s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:09 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 Sep 10 20:19:09 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:09 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8" returned: 0 in 0.313s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:09 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 is being set with open permissions: ugo+rw Sep 10 20:19:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:09 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 Sep 10 20:19:09 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:09 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8" returned: 0 in 0.242s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:09 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.info Sep 10 20:19:09 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:10 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.info" returned: 0 in 0.266s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:10 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.info is being set with open permissions: ugo+rw Sep 10 20:19:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:10 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.info Sep 10 20:19:10 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:10 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.info" returned: 0 in 0.249s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:10 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6b82f65f-51fc-4db2-bc04-fbb02d9db13b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Create snapshot completed successfully Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Acquiring lock "cinder-e9e38172-25f0-4bae-9aae-5d47dd5d22d8-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-e9e38172-25f0-4bae-9aae-5d47dd5d22d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Acquiring lock "cinder-quobyte-72b6c81d-d032-49b6-9905-1ed7dab89d87" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-quobyte-72b6c81d-d032-49b6-9905-1ed7dab89d87" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Acquiring lock "cinder-quobyte-e9e38172-25f0-4bae-9aae-5d47dd5d22d8" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-quobyte-e9e38172-25f0-4bae-9aae-5d47dd5d22d8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Deleting offline snapshot e9e38172-25f0-4bae-9aae-5d47dd5d22d8 of volume 72b6c81d-d032-49b6-9905-1ed7dab89d87 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] snapshot_file for this snap is: volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90bed35-cfd1-469b-9464-0b5a80442c8a]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:11 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 Sep 10 20:19:11 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:11 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8" returned: 0 in 0.378s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b6c81d-d032-49b6-9905-1ed7dab89d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[17635d2a-7aee-45ae-8bb8-2d61ec2bd681]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:11 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 Sep 10 20:19:11 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:11 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87" returned: 0 in 0.370s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:11 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 Sep 10 20:19:11 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:12 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8" returned: 0 in 0.305s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:12 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8 Sep 10 20:19:12 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:12 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87.e9e38172-25f0-4bae-9aae-5d47dd5d22d8" returned: 0 in 0.242s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-quobyte-e9e38172-25f0-4bae-9aae-5d47dd5d22d8" released by "_delete_snapshot" :: held 1.393s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-quobyte-72b6c81d-d032-49b6-9905-1ed7dab89d87" released by "delete_snapshot" :: held 1.417s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:12 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Created reservations ['3bc79481-8067-43c2-ba6c-011ee4c47589', '9712c1d7-d5d4-4516-a198-0a2784e1907d', '86ae80c8-4c6e-41ca-9afb-e2de6cbfc283', '6f222bd3-ee81-4c9e-8bc0-e47878f06b7d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Delete snapshot completed successfully. Sep 10 20:19:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-61d14c7e-9af5-499e-83d3-a48323d5bfb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-e9e38172-25f0-4bae-9aae-5d47dd5d22d8-delete_snapshot" released by "delete_snapshot" :: held 1.555s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Acquiring lock "cinder-72b6c81d-d032-49b6-9905-1ed7dab89d87-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-72b6c81d-d032-49b6-9905-1ed7dab89d87-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Acquiring lock "cinder-quobyte-72b6c81d-d032-49b6-9905-1ed7dab89d87" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-quobyte-72b6c81d-d032-49b6-9905-1ed7dab89d87" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:13 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[407ffb7c-8fae-403e-abc6-3a58d1ea9560]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:13 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 Sep 10 20:19:13 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:13 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87" returned: 0 in 0.395s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:13 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87 Sep 10 20:19:13 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:14 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-72b6c81d-d032-49b6-9905-1ed7dab89d87" returned: 0 in 0.245s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-quobyte-72b6c81d-d032-49b6-9905-1ed7dab89d87" released by "delete_volume" :: held 0.700s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Created reservations ['2c7b9232-66bf-4be6-9e8f-83f1301e99ed', 'ab29a07a-26fc-4d94-87c7-c7b4ccbc8a45', '72fe9495-ad59-4973-87a9-e866ee6d9da4', '2f94bd6b-ba21-4ab9-a7c6-2b8cd18c87a6'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:14 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:14 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:14 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.260s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Deleted volume successfully. Sep 10 20:19:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8a169f2-49c4-4d6b-86c4-1503dd4a266b tempest-VolumeSnapshotQuotasNegativeTestJSON-1404264321 None] Lock "cinder-72b6c81d-d032-49b6-9905-1ed7dab89d87-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:20 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:20 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:20 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.280s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:19:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (718501de-e6bc-4a63-bde4-3632c8d1a83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2b193a-f5f1-4bfc-bc35-9cea983b7016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2b193a-f5f1-4bfc-bc35-9cea983b7016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880524722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f439a2-2524-43b5-8312-04643a8560a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:21Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1b329b-abc7-471b-a44b-bd578d912de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1b329b-abc7-471b-a44b-bd578d912de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac56d2ba-40b1-4ae8-91f0-0da68eeddf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac56d2ba-40b1-4ae8-91f0-0da68eeddf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65f439a2-2524-43b5-8312-04643a8560a5', 'volume_name': 'volume-65f439a2-2524-43b5-8312-04643a8560a5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258a60e9-0db8-4bdd-9c6f-c0f70f120674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258a60e9-0db8-4bdd-9c6f-c0f70f120674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911bad83-a580-4f21-9cdb-f65720eb231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:21 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume 65f439a2-2524-43b5-8312-04643a8560a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65f439a2-2524-43b5-8312-04643a8560a5', 'volume_size': 1} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880524722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f439a2-2524-43b5-8312-04643a8560a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:21Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Creating volume 65f439a2-2524-43b5-8312-04643a8560a5 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:21 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:21 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 1073741824 Sep 10 20:19:21 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:21 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 1073741824" returned: 0 in 0.453s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:21 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 Sep 10 20:19:21 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:22 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5" returned: 0 in 0.249s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911bad83-a580-4f21-9cdb-f65720eb231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65f439a2-2524-43b5-8312-04643a8560a5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749f2325-b7e5-4a21-89bf-2691cd661484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:22 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume volume-65f439a2-2524-43b5-8312-04643a8560a5 (65f439a2-2524-43b5-8312-04643a8560a5): created successfully Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749f2325-b7e5-4a21-89bf-2691cd661484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (718501de-e6bc-4a63-bde4-3632c8d1a83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:22 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fb522d8c-ac34-429c-ac02-4340c850cf33 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created volume successfully. Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Creating offline snapshot c1686514-68eb-40d0-8c21-149762fb6346 of volume 65f439a2-2524-43b5-8312-04643a8560a5 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[696451fb-0b19-4d95-b4bf-715a4eae112c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:22 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 Sep 10 20:19:22 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:22 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5" returned: 0 in 0.406s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:22 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 1G Sep 10 20:19:22 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:23 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 1G" returned: 0 in 0.444s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65f439a2-2524-43b5-8312-04643a8560a5 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:23 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65f439a2-2524-43b5-8312-04643a8560a5 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 Sep 10 20:19:23 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:23 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65f439a2-2524-43b5-8312-04643a8560a5 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346" returned: 0 in 0.321s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:23 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 is being set with open permissions: ugo+rw Sep 10 20:19:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:23 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 Sep 10 20:19:23 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:23 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:23 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.info Sep 10 20:19:23 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:24 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.info" returned: 0 in 0.255s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:24 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.info is being set with open permissions: ugo+rw Sep 10 20:19:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:24 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.info Sep 10 20:19:24 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:24 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.info" returned: 0 in 0.263s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:24 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8b0278a4-09fe-4487-9e02-2b7e8a887c2b tempest-CreateVolumesFromSnapshotTest-693270976 None] Create snapshot completed successfully Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (a7a5e4aa-2598-42ac-8d90-8ff77d9b5406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa776e7-54fb-445b-b5cd-1fd8eb348eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa776e7-54fb-445b-b5cd-1fd8eb348eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650603370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfd8fa3-f050-4309-9998-ba0186d008d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:26Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd54716-2ec2-46cd-b034-f2a13c5a087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd54716-2ec2-46cd-b034-f2a13c5a087c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f651d7-ea14-404f-b9b2-f7e17d9fa2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f651d7-ea14-404f-b9b2-f7e17d9fa2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfd8fa3-f050-4309-9998-ba0186d008d7', 'volume_name': 'volume-6cfd8fa3-f050-4309-9998-ba0186d008d7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed405499-f6df-4db2-a9df-9590c39dd0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed405499-f6df-4db2-a9df-9590c39dd0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e0bafd-9fcd-41c1-89a8-79b3083ba539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume 6cfd8fa3-f050-4309-9998-ba0186d008d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfd8fa3-f050-4309-9998-ba0186d008d7', 'volume_size': 1} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650603370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfd8fa3-f050-4309-9998-ba0186d008d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:26Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Creating volume 6cfd8fa3-f050-4309-9998-ba0186d008d7 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:26 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:26 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 1073741824 Sep 10 20:19:26 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (7f0165d8-2daf-468b-bc65-0e6bf88e3a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70525bba-8d88-4ebb-b0ba-bfaaf1ce4bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70525bba-8d88-4ebb-b0ba-bfaaf1ce4bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-803990214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e2132c-e63a-41b1-b4b4-1ff86e14be38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:26Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eb21f4-71d7-4058-ae78-c5225a0c3aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eb21f4-71d7-4058-ae78-c5225a0c3aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c885aa-e6c9-44f9-b8ad-a4b04b6d294a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c885aa-e6c9-44f9-b8ad-a4b04b6d294a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e2132c-e63a-41b1-b4b4-1ff86e14be38', 'volume_name': 'volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4eb254-3891-44af-9296-863d5fc8990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4eb254-3891-44af-9296-863d5fc8990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad2db8b-567c-4ee2-8359-bdbde822adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:26 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume 34e2132c-e63a-41b1-b4b4-1ff86e14be38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38', 'volume_size': 1} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:26 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 1073741824" returned: 0 in 0.676s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:26 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 Sep 10 20:19:26 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (ff3c372f-e737-4bb2-985b-879fb5045379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef59d72-6bdf-4133-b14a-70e625352824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef59d72-6bdf-4133-b14a-70e625352824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1755430289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849aee03-cbe9-4dcd-a58a-855e2aa8c533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:27Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767d41e9-ba26-4f5d-ac24-1b32e33a4276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767d41e9-ba26-4f5d-ac24-1b32e33a4276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e168e3b-1a59-4a3e-b459-7ce526289827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e168e3b-1a59-4a3e-b459-7ce526289827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '849aee03-cbe9-4dcd-a58a-855e2aa8c533', 'volume_name': 'volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7901f7-9c88-494d-b433-bf13edd546d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7901f7-9c88-494d-b433-bf13edd546d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c64cb0-be22-403d-8770-9e91e8f0ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume 849aee03-cbe9-4dcd-a58a-855e2aa8c533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533', 'volume_size': 1} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:27 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7" returned: 0 in 0.422s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-803990214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e2132c-e63a-41b1-b4b4-1ff86e14be38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:26Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Creating volume 34e2132c-e63a-41b1-b4b4-1ff86e14be38 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:27 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e0bafd-9fcd-41c1-89a8-79b3083ba539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfd8fa3-f050-4309-9998-ba0186d008d7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45413152-b8a5-49fb-9cef-7f10f2de581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 1073741824 Sep 10 20:19:27 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 (6cfd8fa3-f050-4309-9998-ba0186d008d7): created successfully Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45413152-b8a5-49fb-9cef-7f10f2de581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (a7a5e4aa-2598-42ac-8d90-8ff77d9b5406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e9439a3c-77e6-4988-95a5-4a895becaa8d tempest-CreateVolumesFromSnapshotTest-693270976 None] Created volume successfully. Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Flow 'volume_create_manager' (d3beda89-8c16-4aed-a4b5-0f3112ffb79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc81b664-bc68-4423-b951-953ea1057eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc81b664-bc68-4423-b951-953ea1057eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1576394932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61864789-0548-4f84-bb1b-c149a4869e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955cfec24af14b6d9f983f1b4db3738b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:28Z,use_quota=True,user_id='2576d99cb7364364b6aa3a01677652d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723c65b5-aba7-49c1-b5d8-8b57a508f13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723c65b5-aba7-49c1-b5d8-8b57a508f13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db0d87a-0164-408b-9628-baf2732ea966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db0d87a-0164-408b-9628-baf2732ea966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61864789-0548-4f84-bb1b-c149a4869e5f', 'volume_name': 'volume-61864789-0548-4f84-bb1b-c149a4869e5f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b942faa5-b295-47ff-9139-74978ae520cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b942faa5-b295-47ff-9139-74978ae520cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997c5ebf-722b-4bac-974b-3806bc3f756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Volume 61864789-0548-4f84-bb1b-c149a4869e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61864789-0548-4f84-bb1b-c149a4869e5f', 'volume_size': 1} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (fec8ce9f-e213-4c68-a453-2bbd9717d063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de524db-da27-4582-91e9-76c4d6db4d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de524db-da27-4582-91e9-76c4d6db4d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-80472629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cac5d2-9357-4988-a25d-45d2637edea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:28Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8566b16-30e0-4acb-a099-5c8dfb66da16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8566b16-30e0-4acb-a099-5c8dfb66da16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58405277-9961-479f-84d8-9f77facf43f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58405277-9961-479f-84d8-9f77facf43f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0cac5d2-9357-4988-a25d-45d2637edea0', 'volume_name': 'volume-c0cac5d2-9357-4988-a25d-45d2637edea0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b627e4-ab54-45d0-acc4-abf4e4f1ac8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b627e4-ab54-45d0-acc4-abf4e4f1ac8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b008d4-6984-4aa2-a036-db24054dc6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume c0cac5d2-9357-4988-a25d-45d2637edea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0cac5d2-9357-4988-a25d-45d2637edea0', 'volume_size': 1} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:27 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (aac3438d-2faf-4805-8797-523f8bad8f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f3f48b-fca0-4f47-945c-b2aeee3c56d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 1073741824" returned: 0 in 0.686s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f3f48b-fca0-4f47-945c-b2aeee3c56d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123441883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30669038-43c0-4756-ac39-c37d365703c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:28Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4139a4e-3fb2-47fd-85db-56690f21dd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4139a4e-3fb2-47fd-85db-56690f21dd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca0752d-8d65-4c8a-add0-da60c9a65d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca0752d-8d65-4c8a-add0-da60c9a65d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30669038-43c0-4756-ac39-c37d365703c2', 'volume_name': 'volume-30669038-43c0-4756-ac39-c37d365703c2', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b597cc-17e7-48dc-8b15-2fe95ce0dd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b597cc-17e7-48dc-8b15-2fe95ce0dd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296061c0-cd02-4819-b5cc-e86bf8127e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:28 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume 30669038-43c0-4756-ac39-c37d365703c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30669038-43c0-4756-ac39-c37d365703c2', 'volume_size': 1} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:28 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 Sep 10 20:19:28 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:28 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38" returned: 0 in 0.274s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1755430289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849aee03-cbe9-4dcd-a58a-855e2aa8c533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:27Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Creating volume 849aee03-cbe9-4dcd-a58a-855e2aa8c533 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:28 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad2db8b-567c-4ee2-8359-bdbde822adeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3917ab3-e6f8-4dcf-8fbb-9a3c576f10ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:28 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 1073741824 Sep 10 20:19:28 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:28 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 (34e2132c-e63a-41b1-b4b4-1ff86e14be38): created successfully Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3917ab3-e6f8-4dcf-8fbb-9a3c576f10ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (7f0165d8-2daf-468b-bc65-0e6bf88e3a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-064a5c02-95e5-4c4c-a3f2-8742e702d747 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created volume successfully. Sep 10 20:19:28 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 1073741824" returned: 0 in 0.399s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:28 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 Sep 10 20:19:28 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:29 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533" returned: 0 in 0.250s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.328s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1576394932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61864789-0548-4f84-bb1b-c149a4869e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955cfec24af14b6d9f983f1b4db3738b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:28Z,use_quota=True,user_id='2576d99cb7364364b6aa3a01677652d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Creating volume 61864789-0548-4f84-bb1b-c149a4869e5f {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:29 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c64cb0-be22-403d-8770-9e91e8f0ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:29 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f 1073741824 Sep 10 20:19:29 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe90f76-5452-4625-b9e3-b37a8a2065be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:29 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 (849aee03-cbe9-4dcd-a58a-855e2aa8c533): created successfully Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe90f76-5452-4625-b9e3-b37a8a2065be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (ff3c372f-e737-4bb2-985b-879fb5045379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:29 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-133e10a5-e21f-4bab-b974-aa39e50d2d29 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created volume successfully. Sep 10 20:19:29 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f 1073741824" returned: 0 in 0.408s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:29 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f Sep 10 20:19:29 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:29 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f" returned: 0 in 0.244s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.910s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-80472629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cac5d2-9357-4988-a25d-45d2637edea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:28Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Creating volume c0cac5d2-9357-4988-a25d-45d2637edea0 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:29 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:29 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0 1073741824 Sep 10 20:19:29 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997c5ebf-722b-4bac-974b-3806bc3f756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61864789-0548-4f84-bb1b-c149a4869e5f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c038420e-ab0e-4fa9-affa-7b256ff70be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:29 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Volume volume-61864789-0548-4f84-bb1b-c149a4869e5f (61864789-0548-4f84-bb1b-c149a4869e5f): created successfully Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c038420e-ab0e-4fa9-affa-7b256ff70be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Flow 'volume_create_manager' (d3beda89-8c16-4aed-a4b5-0f3112ffb79c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:29 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5a347610-9c24-4503-8f1d-9a82ae6dac1e tempest-VolumesListAdminTestJSON-1036455403 None] Created volume successfully. Sep 10 20:19:30 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0 1073741824" returned: 0 in 0.409s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:30 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0 Sep 10 20:19:30 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:30 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0" returned: 0 in 0.255s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.404s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123441883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30669038-43c0-4756-ac39-c37d365703c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acaf239946740d5ba443359db062375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:28Z,use_quota=True,user_id='3e40cbe0248d463cb0d884554d4a0505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Creating volume 30669038-43c0-4756-ac39-c37d365703c2 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:30 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b008d4-6984-4aa2-a036-db24054dc6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0cac5d2-9357-4988-a25d-45d2637edea0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:30 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2 1073741824 Sep 10 20:19:30 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4267f8fe-0d02-4d32-8c47-2bf5c4b3d2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume volume-c0cac5d2-9357-4988-a25d-45d2637edea0 (c0cac5d2-9357-4988-a25d-45d2637edea0): created successfully Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4267f8fe-0d02-4d32-8c47-2bf5c4b3d2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (fec8ce9f-e213-4c68-a453-2bbd9717d063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a892f0f9-93cc-4460-a7d4-26730a204d5e tempest-CreateVolumesFromSnapshotTest-693270976 None] Created volume successfully. Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Flow 'volume_create_manager' (f6967b2d-04ad-40f2-884d-6fad10e97763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3530cb0f-4bba-4f7d-b0aa-8ee06cc15a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:30 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3530cb0f-4bba-4f7d-b0aa-8ee06cc15a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-740376795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee83289b-e76d-44f7-8bdf-8a72e5d26fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955cfec24af14b6d9f983f1b4db3738b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:31Z,use_quota=True,user_id='2576d99cb7364364b6aa3a01677652d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a302a133-9121-4145-9182-4459bd67b50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a302a133-9121-4145-9182-4459bd67b50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8facfb-e2f7-4065-b6c5-ad426b50c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8facfb-e2f7-4065-b6c5-ad426b50c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee83289b-e76d-44f7-8bdf-8a72e5d26fb1', 'volume_name': 'volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de33ecc-8a10-48b8-973c-2a50648936e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de33ecc-8a10-48b8-973c-2a50648936e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b6067c-dc56-41b5-8a16-ea3be1f78843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Volume ee83289b-e76d-44f7-8bdf-8a72e5d26fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1', 'volume_size': 1} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2 1073741824" returned: 0 in 0.472s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:30 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2 Sep 10 20:19:30 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:31 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2" returned: 0 in 0.250s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-740376795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee83289b-e76d-44f7-8bdf-8a72e5d26fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955cfec24af14b6d9f983f1b4db3738b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:31Z,use_quota=True,user_id='2576d99cb7364364b6aa3a01677652d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Creating volume ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:31 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296061c0-cd02-4819-b5cc-e86bf8127e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30669038-43c0-4756-ac39-c37d365703c2', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52e3bee-b517-47b7-9810-fe26c8cfdbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:31 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 1073741824 Sep 10 20:19:31 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Volume volume-30669038-43c0-4756-ac39-c37d365703c2 (30669038-43c0-4756-ac39-c37d365703c2): created successfully Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52e3bee-b517-47b7-9810-fe26c8cfdbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Flow 'volume_create_manager' (aac3438d-2faf-4805-8797-523f8bad8f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-bb44fa29-6922-49a7-91bf-ef16abf87098 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created volume successfully. Sep 10 20:19:31 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 1073741824" returned: 0 in 0.412s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:31 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 Sep 10 20:19:31 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:31 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1" returned: 0 in 0.237s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b6067c-dc56-41b5-8a16-ea3be1f78843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac76b56-b6b0-4198-8894-5951277f4742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Volume volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 (ee83289b-e76d-44f7-8bdf-8a72e5d26fb1): created successfully Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac76b56-b6b0-4198-8894-5951277f4742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Flow 'volume_create_manager' (f6967b2d-04ad-40f2-884d-6fad10e97763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-dd436d7f-118a-4881-ac2a-7555c11d3965 tempest-VolumesListAdminTestJSON-1036455403 None] Created volume successfully. Sep 10 20:19:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-30669038-43c0-4756-ac39-c37d365703c2-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-30669038-43c0-4756-ac39-c37d365703c2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-quobyte-30669038-43c0-4756-ac39-c37d365703c2" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-30669038-43c0-4756-ac39-c37d365703c2" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:32 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e510d57-b2e9-4cc5-acc0-3a85ba821c69]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:32 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2 Sep 10 20:19:32 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:32 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2" returned: 0 in 0.386s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:32 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2 Sep 10 20:19:32 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:33 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-30669038-43c0-4756-ac39-c37d365703c2" returned: 0 in 0.260s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-30669038-43c0-4756-ac39-c37d365703c2" released by "delete_volume" :: held 0.687s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created reservations ['96f43245-8fad-4460-bae8-6f1dd577be84', '59a16543-e0ec-4952-9143-a5ddcf348d9f', 'd59bc56c-aaa6-41d1-a18b-bbf69067739b', '1faf03b0-3e9c-4bed-b809-c2e005fc8e22'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:33 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:33 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Flow 'volume_create_manager' (2918bd30-7372-499d-9603-4b94f3c97959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db35d088-24e6-46ba-9c00-b65b2da92269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db35d088-24e6-46ba-9c00-b65b2da92269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1586514387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955cfec24af14b6d9f983f1b4db3738b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:33Z,use_quota=True,user_id='2576d99cb7364364b6aa3a01677652d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433de043-684b-4fe4-a76c-0b1b40d5f35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433de043-684b-4fe4-a76c-0b1b40d5f35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8244d66b-497d-478a-8589-63eaa9428b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8244d66b-497d-478a-8589-63eaa9428b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60', 'volume_name': 'volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd32ff7-5569-498a-854a-ba4336638f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd32ff7-5569-498a-854a-ba4336638f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f45b37c-d1f2-43df-84fb-6d3d2c3116d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Volume 2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60', 'volume_size': 1} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1586514387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955cfec24af14b6d9f983f1b4db3738b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:33Z,use_quota=True,user_id='2576d99cb7364364b6aa3a01677652d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Creating volume 2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:33 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:33 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 1073741824 Sep 10 20:19:33 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-c0cac5d2-9357-4988-a25d-45d2637edea0-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:33 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-c0cac5d2-9357-4988-a25d-45d2637edea0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.294s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Deleted volume successfully. Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e091181c-a961-447a-99e9-25d2f9f36d38 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-30669038-43c0-4756-ac39-c37d365703c2-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-quobyte-c0cac5d2-9357-4988-a25d-45d2637edea0" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-c0cac5d2-9357-4988-a25d-45d2637edea0" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89fdf20-b739-4724-8917-6cf271a6eb82]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:33 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0 Sep 10 20:19:33 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:34 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 1073741824" returned: 0 in 0.518s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:34 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 Sep 10 20:19:34 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:34 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0" returned: 0 in 0.400s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:34 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0 Sep 10 20:19:34 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:34 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60" returned: 0 in 0.282s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f45b37c-d1f2-43df-84fb-6d3d2c3116d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce49eba8-8e96-4cd9-a119-00bddad20b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:34 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Volume volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 (2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60): created successfully Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce49eba8-8e96-4cd9-a119-00bddad20b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Flow 'volume_create_manager' (2918bd30-7372-499d-9603-4b94f3c97959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:34 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c0cac5d2-9357-4988-a25d-45d2637edea0" returned: 0 in 0.264s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-c0cac5d2-9357-4988-a25d-45d2637edea0" released by "delete_volume" :: held 0.709s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-396ee8e2-0545-4498-9a0b-bf4d675b4e5c tempest-VolumesListAdminTestJSON-1036455403 None] Created volume successfully. Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created reservations ['180beb89-dd1d-4e1c-94c2-a0422b573514', '2fef1987-e097-492e-b60a-3db6b4faaccd', '9258ba32-0eec-4aec-9004-a39089ba6349', 'b441c441-9783-412c-a0ed-59a78f41251f'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:34 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:34 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:34 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.244s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Deleted volume successfully. Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-849aee03-cbe9-4dcd-a58a-855e2aa8c533-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-269cfe51-0c81-4d63-ae6b-b515bfedb7c1 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-c0cac5d2-9357-4988-a25d-45d2637edea0-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-849aee03-cbe9-4dcd-a58a-855e2aa8c533-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-quobyte-849aee03-cbe9-4dcd-a58a-855e2aa8c533" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-849aee03-cbe9-4dcd-a58a-855e2aa8c533" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b3eabb-614d-4d66-b5a5-51c6847a797e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:35 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 Sep 10 20:19:35 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:35 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533" returned: 0 in 0.347s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:35 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533 Sep 10 20:19:35 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:35 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-849aee03-cbe9-4dcd-a58a-855e2aa8c533" returned: 0 in 0.240s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-849aee03-cbe9-4dcd-a58a-855e2aa8c533" released by "delete_volume" :: held 0.629s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Created reservations ['99b7e6b4-c5a6-4177-969b-7e9bf44a5750', '4d149a6a-7b96-4d45-9d71-79d59ae05c71', '360e576d-44eb-488c-8747-0fdd8eb4b5b4', 'fd99fbc4-4a28-4b41-80e2-8eaf74014dcd'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:35 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:35 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:35 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.239s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Deleted volume successfully. Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-26ebd9dc-ece5-431d-9824-6c82a7f36aef tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-849aee03-cbe9-4dcd-a58a-855e2aa8c533-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-34e2132c-e63a-41b1-b4b4-1ff86e14be38-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-34e2132c-e63a-41b1-b4b4-1ff86e14be38-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-quobyte-34e2132c-e63a-41b1-b4b4-1ff86e14be38" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-34e2132c-e63a-41b1-b4b4-1ff86e14be38" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb7873-6de9-4bac-ab95-428994784b8b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:36 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 Sep 10 20:19:36 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Flow 'volume_create_manager' (d6527a73-3cea-4575-950c-0c2b0764cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3499141c-1a12-40af-b473-5ac014efd3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3499141c-1a12-40af-b473-5ac014efd3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49e4b08-9943-4793-9a00-d6eca128d0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078d18d6031f4f75a331ee6d783ee781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:36Z,use_quota=True,user_id='6815a564694847288f1058578def6976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284f9c57-6bd8-4f88-8a25-6fd279010c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284f9c57-6bd8-4f88-8a25-6fd279010c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1db2ba2-f3ff-4fcc-bebc-31eb3da87131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1db2ba2-f3ff-4fcc-bebc-31eb3da87131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49e4b08-9943-4793-9a00-d6eca128d0cd', 'volume_name': 'volume-b49e4b08-9943-4793-9a00-d6eca128d0cd', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad02d462-5c27-4f71-90d0-340e88c1da27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad02d462-5c27-4f71-90d0-340e88c1da27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ed1a37-51ba-4a81-b142-3aff489c945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:36 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Volume b49e4b08-9943-4793-9a00-d6eca128d0cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49e4b08-9943-4793-9a00-d6eca128d0cd', 'volume_size': 1} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49e4b08-9943-4793-9a00-d6eca128d0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078d18d6031f4f75a331ee6d783ee781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:36Z,use_quota=True,user_id='6815a564694847288f1058578def6976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Creating volume b49e4b08-9943-4793-9a00-d6eca128d0cd {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:36 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:36 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd 1073741824 Sep 10 20:19:36 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:36 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38" returned: 0 in 0.443s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:36 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38 Sep 10 20:19:36 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:36 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd 1073741824" returned: 0 in 0.417s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:36 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd Sep 10 20:19:36 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:36 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34e2132c-e63a-41b1-b4b4-1ff86e14be38" returned: 0 in 0.303s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-34e2132c-e63a-41b1-b4b4-1ff86e14be38" released by "delete_volume" :: held 0.811s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created reservations ['3a7c9f11-40c0-441c-8329-992bcdcaf359', '03802ec4-1689-4b63-8739-777fb863c2df', '004c2b22-5327-47cb-bd02-818ada27c03d', 'b66ec218-ea62-4f8d-9a92-e2d9cc3f404a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:37 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:37 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:37 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd" returned: 0 in 0.281s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ed1a37-51ba-4a81-b142-3aff489c945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49e4b08-9943-4793-9a00-d6eca128d0cd', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1f1ce4-27e6-4d9c-93d5-e75d15cfbb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:37 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Volume volume-b49e4b08-9943-4793-9a00-d6eca128d0cd (b49e4b08-9943-4793-9a00-d6eca128d0cd): created successfully Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1f1ce4-27e6-4d9c-93d5-e75d15cfbb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Flow 'volume_create_manager' (d6527a73-3cea-4575-950c-0c2b0764cddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-6cfd8fa3-f050-4309-9998-ba0186d008d7-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-72048ad2-c58f-454c-94b2-4ca7b1f0117e tempest-VolumesListAdminTestJSON-766263568 None] Created volume successfully. Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-6cfd8fa3-f050-4309-9998-ba0186d008d7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-quobyte-6cfd8fa3-f050-4309-9998-ba0186d008d7" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:37 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.281s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-6cfd8fa3-f050-4309-9998-ba0186d008d7" acquired by "delete_volume" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Deleted volume successfully. Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46f8978-428b-4d6f-b3e0-4b8c9d911327]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-88f63ea1-0dc3-47e2-a531-8ff0cf803de0 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-34e2132c-e63a-41b1-b4b4-1ff86e14be38-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Acquiring lock "cinder-b49e4b08-9943-4793-9a00-d6eca128d0cd-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:37 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 Sep 10 20:19:37 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Lock "cinder-b49e4b08-9943-4793-9a00-d6eca128d0cd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Acquiring lock "cinder-quobyte-b49e4b08-9943-4793-9a00-d6eca128d0cd" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Lock "cinder-quobyte-b49e4b08-9943-4793-9a00-d6eca128d0cd" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b889b9a7-f7ad-42da-8877-d7e1e0df48c8]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "cinder-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "cinder-quobyte-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-quobyte-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b31840-bb8e-4019-bc0a-5ed0364a3c63]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:37 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd Sep 10 20:19:37 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:37 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7" returned: 0 in 0.458s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:37 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7 Sep 10 20:19:37 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:37 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 Sep 10 20:19:37 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:37 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd" returned: 0 in 0.433s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:38 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd Sep 10 20:19:38 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:38 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6cfd8fa3-f050-4309-9998-ba0186d008d7" returned: 0 in 0.268s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-6cfd8fa3-f050-4309-9998-ba0186d008d7" released by "delete_volume" :: held 0.780s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:38 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60" returned: 0 in 0.395s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:38 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60 Sep 10 20:19:38 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created reservations ['121f77f3-5efa-4067-8f96-147bb5892440', 'bd9ab1d0-e7a4-4423-ab01-a8ee37959f1b', '97a0b08f-4dd2-4c9b-be87-b100ca5a5156', '40bbd1d4-ca1c-4a2f-94b8-327a6f70959d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:38 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:38 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:38 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b49e4b08-9943-4793-9a00-d6eca128d0cd" returned: 0 in 0.280s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Lock "cinder-quobyte-b49e4b08-9943-4793-9a00-d6eca128d0cd" released by "delete_volume" :: held 0.780s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:38 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60" returned: 0 in 0.295s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Created reservations ['16370eeb-3618-495b-8578-16b031a5c98d', '26185474-037b-42ef-94bd-7624f0fa73be', '221e1322-82b9-4fea-b5ed-c8e07818462b', 'a99dbb1a-e9a9-4bae-b222-d03d2ca6f26e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-quobyte-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60" released by "delete_volume" :: held 0.746s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-c1686514-68eb-40d0-8c21-149762fb6346-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-c1686514-68eb-40d0-8c21-149762fb6346-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-quobyte-65f439a2-2524-43b5-8312-04643a8560a5" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-65f439a2-2524-43b5-8312-04643a8560a5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-quobyte-c1686514-68eb-40d0-8c21-149762fb6346" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:38 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.316s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-c1686514-68eb-40d0-8c21-149762fb6346" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:38 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:38 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Deleting offline snapshot c1686514-68eb-40d0-8c21-149762fb6346 of volume 65f439a2-2524-43b5-8312-04643a8560a5 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] snapshot_file for this snap is: volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:19:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Deleted volume successfully. Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Created reservations ['6480c949-7e6c-4ac4-bffb-812fa88ce18d', '3a5ca1a7-5d01-4ab1-be43-a5e2751c3ca5', 'ecaea8d6-652c-44d5-882b-58a3a942e90f', 'be158fa3-b1f9-4eb4-b560-1cf298d195d6'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[734aef9a-a136-4f7f-9088-338bdfaced12]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-cbb3ba78-2f6b-44d9-bdc8-f3004c701900 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-6cfd8fa3-f050-4309-9998-ba0186d008d7-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:38 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:38 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:38 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 Sep 10 20:19:38 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:38 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.284s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Deleted volume successfully. Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6ee3d784-0d04-4147-93ea-4aa436a48c2b tempest-VolumesListAdminTestJSON-766263568 None] Lock "cinder-b49e4b08-9943-4793-9a00-d6eca128d0cd-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "cinder-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "cinder-quobyte-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-quobyte-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5c8015-ea23-4158-9fc3-5cc279082b24]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:39 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.323s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Deleted volume successfully. Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1fa764ef-92b1-473b-8236-c4484af51737 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-2fe16b9b-9fec-4c2c-b9e2-8ec86122cb60-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:39 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 Sep 10 20:19:39 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:39 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346" returned: 0 in 0.508s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65f439a2-2524-43b5-8312-04643a8560a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab4d3c-8e72-4847-8736-83dd52dc15d1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:39 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 Sep 10 20:19:39 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:39 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:39 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1 Sep 10 20:19:39 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:39 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5" returned: 0 in 0.421s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:39 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 Sep 10 20:19:39 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:39 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1" returned: 0 in 0.275s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-quobyte-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1" released by "delete_volume" :: held 0.699s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Created reservations ['58f389b3-7891-4c38-b365-b0786ff9326b', '8ecc32ba-5c4e-4f61-85ba-a53e44e3309b', '29c95423-6d98-4027-95d0-150c06539f81', 'a18e25e2-9796-43cf-a575-e088fdcb7ee1'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:39 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:39 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:39 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346" returned: 0 in 0.363s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:39 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346 Sep 10 20:19:39 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:40 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.262s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:40 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Deleted volume successfully. Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7de6f5cb-0855-4881-bad5-fd1b876b8056 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-ee83289b-e76d-44f7-8bdf-8a72e5d26fb1-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "cinder-61864789-0548-4f84-bb1b-c149a4869e5f-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-61864789-0548-4f84-bb1b-c149a4869e5f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "cinder-quobyte-61864789-0548-4f84-bb1b-c149a4869e5f" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-quobyte-61864789-0548-4f84-bb1b-c149a4869e5f" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:40 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5.c1686514-68eb-40d0-8c21-149762fb6346" returned: 0 in 0.290s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a45c17-8027-47bd-91fd-187d3c036eac]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-c1686514-68eb-40d0-8c21-149762fb6346" released by "_delete_snapshot" :: held 1.714s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-65f439a2-2524-43b5-8312-04643a8560a5" released by "delete_snapshot" :: held 1.769s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created reservations ['93e37a28-730c-407d-8164-2e4d3a17b0fd', '9d6823f8-1b27-4a3d-ba9b-14fc9922f9fb', 'dbf00168-81e3-44b0-bbc1-1daadf6905ef', 'bb0cbea6-98fb-4bfa-a75a-c4a231c7970d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:40 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f Sep 10 20:19:40 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:40 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Delete snapshot completed successfully. Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-905949e8-b1df-4924-9ac8-bbb24f25c2a7 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-c1686514-68eb-40d0-8c21-149762fb6346-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-65f439a2-2524-43b5-8312-04643a8560a5-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:40 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-65f439a2-2524-43b5-8312-04643a8560a5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:40 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f Sep 10 20:19:40 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "cinder-quobyte-65f439a2-2524-43b5-8312-04643a8560a5" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-65f439a2-2524-43b5-8312-04643a8560a5" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a3a900-fadc-4aa1-817b-a0bc68159e9d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:40 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 Sep 10 20:19:40 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:40 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-61864789-0548-4f84-bb1b-c149a4869e5f" returned: 0 in 0.272s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-quobyte-61864789-0548-4f84-bb1b-c149a4869e5f" released by "delete_volume" :: held 0.713s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:40 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Created reservations ['0d32770e-aca9-42c0-a9b7-06e46d06ac69', '828f929f-6cb2-4330-b035-6feabccdb38e', 'b7c45a9f-7fcd-4025-bf55-2ceec891dfe5', 'c7e0b0b7-b1ca-46d5-adae-e984ccf03659'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:41 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:41 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:41 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5" returned: 0 in 0.373s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:41 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5 Sep 10 20:19:41 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:41 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.261s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Deleted volume successfully. Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-25057e42-af35-4d3c-8668-e070229a31e3 tempest-VolumesListAdminTestJSON-1036455403 None] Lock "cinder-61864789-0548-4f84-bb1b-c149a4869e5f-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:41 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-65f439a2-2524-43b5-8312-04643a8560a5" returned: 0 in 0.288s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-quobyte-65f439a2-2524-43b5-8312-04643a8560a5" released by "delete_volume" :: held 0.719s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Created reservations ['53294b88-e9dc-471c-8c1f-b16d2209ecc0', '6147bb69-6f26-4f36-8b15-485093a94d75', 'fb033b24-1eba-42d0-a752-83730aa714a0', 'ddcdc2ec-ac7b-4818-824a-54cf4a77962a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:41 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:41 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:41 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.286s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Deleted volume successfully. Sep 10 20:19:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2ffc8cc8-cfb1-4a10-b682-58e1334983c5 tempest-CreateVolumesFromSnapshotTest-693270976 None] Lock "cinder-65f439a2-2524-43b5-8312-04643a8560a5-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:44 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (0a19579d-1a6d-445f-9646-809de1470df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a19494b-8304-4222-8e1b-9f11d28b5e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a19494b-8304-4222-8e1b-9f11d28b5e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-545741400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e325a3-a49f-41ff-a867-70197e4b0771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:45Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533e0bfe-b826-453e-a2d0-071f979006d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:44 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533e0bfe-b826-453e-a2d0-071f979006d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a535fe-8771-428c-a537-0b8257d2e64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a535fe-8771-428c-a537-0b8257d2e64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e325a3-a49f-41ff-a867-70197e4b0771', 'volume_name': 'volume-f1e325a3-a49f-41ff-a867-70197e4b0771', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731a892f-0168-47e3-868a-b812c7077c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731a892f-0168-47e3-868a-b812c7077c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231dfa2d-2635-4d72-b0b0-962ea4d28faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:45 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume f1e325a3-a49f-41ff-a867-70197e4b0771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e325a3-a49f-41ff-a867-70197e4b0771', 'volume_size': 1} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-545741400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e325a3-a49f-41ff-a867-70197e4b0771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:45Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Creating volume f1e325a3-a49f-41ff-a867-70197e4b0771 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:45 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:45 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771 1073741824 Sep 10 20:19:45 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:45 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771 1073741824" returned: 0 in 0.473s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:45 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771 Sep 10 20:19:45 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:45 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771" returned: 0 in 0.265s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231dfa2d-2635-4d72-b0b0-962ea4d28faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e325a3-a49f-41ff-a867-70197e4b0771', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebf96c3-5fbc-484e-aa04-50f47daeec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:45 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume volume-f1e325a3-a49f-41ff-a867-70197e4b0771 (f1e325a3-a49f-41ff-a867-70197e4b0771): created successfully Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebf96c3-5fbc-484e-aa04-50f47daeec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (0a19579d-1a6d-445f-9646-809de1470df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:45 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-27698aa1-6b5d-44d7-be7b-c7bccf80c005 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created volume successfully. Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (1914a6a7-f4bd-40c3-af2b-c0d7c6a84d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a78a2b7-7de8-4538-8bef-4433489bd826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a78a2b7-7de8-4538-8bef-4433489bd826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767125850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b374ecea-009d-4dbc-9475-03f1e10e31e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:46Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b3470c-a106-4ad8-b156-6fd1189f4888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b3470c-a106-4ad8-b156-6fd1189f4888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e670f0-73aa-47a0-928c-0d351340f4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e670f0-73aa-47a0-928c-0d351340f4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b374ecea-009d-4dbc-9475-03f1e10e31e4', 'volume_name': 'volume-b374ecea-009d-4dbc-9475-03f1e10e31e4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90703ec-5f43-4815-a67a-7cfe433136b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90703ec-5f43-4815-a67a-7cfe433136b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2dd46a0-ca67-481e-ab33-ac2381ea5298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:46 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume b374ecea-009d-4dbc-9475-03f1e10e31e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b374ecea-009d-4dbc-9475-03f1e10e31e4', 'volume_size': 1} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767125850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b374ecea-009d-4dbc-9475-03f1e10e31e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:46Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Creating volume b374ecea-009d-4dbc-9475-03f1e10e31e4 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:46 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:46 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 1073741824 Sep 10 20:19:46 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (b4b9de73-5c5b-4f32-8608-10c00fcff8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48544453-fc1e-466e-9aa6-eefbc78d2463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48544453-fc1e-466e-9aa6-eefbc78d2463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95335811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b967f7b-0875-4fcb-9b1b-195c891e35d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:47Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0f4940-84e3-4ae9-b4b2-b47ffc9fc85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0f4940-84e3-4ae9-b4b2-b47ffc9fc85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94195ce6-4b09-425d-a9d2-9093bd5de48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94195ce6-4b09-425d-a9d2-9093bd5de48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b967f7b-0875-4fcb-9b1b-195c891e35d5', 'volume_name': 'volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cf8b69-7e5c-4a41-aa7d-ab046babb237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cf8b69-7e5c-4a41-aa7d-ab046babb237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c9c07d-2177-4e71-9bfc-9cac365c3e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume 0b967f7b-0875-4fcb-9b1b-195c891e35d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5', 'volume_size': 1} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:47 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 1073741824" returned: 0 in 0.563s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:47 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 Sep 10 20:19:47 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (824f643b-9e31-475b-bbcb-8d55acce0bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc44b21-cc10-4217-af0a-7f19d001e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc44b21-cc10-4217-af0a-7f19d001e55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-266328350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91ed665-68d7-4075-bc79-1ee455704baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:47Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a42a1b-ac36-4333-bdc1-0042a5d828ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a42a1b-ac36-4333-bdc1-0042a5d828ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839a5690-bc01-4197-b0e9-7bc2abd8a77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839a5690-bc01-4197-b0e9-7bc2abd8a77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd91ed665-68d7-4075-bc79-1ee455704baf', 'volume_name': 'volume-d91ed665-68d7-4075-bc79-1ee455704baf', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb9e478-f93a-4240-be57-165f0d996a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb9e478-f93a-4240-be57-165f0d996a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6599b53c-86f8-443e-a48e-0d7fed3f36fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume d91ed665-68d7-4075-bc79-1ee455704baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d91ed665-68d7-4075-bc79-1ee455704baf', 'volume_size': 1} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:47 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4" returned: 0 in 0.378s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95335811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b967f7b-0875-4fcb-9b1b-195c891e35d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:47Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Creating volume 0b967f7b-0875-4fcb-9b1b-195c891e35d5 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:47 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2dd46a0-ca67-481e-ab33-ac2381ea5298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b374ecea-009d-4dbc-9475-03f1e10e31e4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 1073741824 Sep 10 20:19:47 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41129080-e3fa-44e6-b610-83d8278c1406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 (b374ecea-009d-4dbc-9475-03f1e10e31e4): created successfully Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41129080-e3fa-44e6-b610-83d8278c1406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (1914a6a7-f4bd-40c3-af2b-c0d7c6a84d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:47 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-cb139d7a-1fe2-4a77-8a98-c1dd0c57a1f3 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created volume successfully. Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (3f7a6721-e3b2-4ae6-ab84-0f8284d35228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6b2770-db4a-4f4d-96c7-f0a7f1128d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6b2770-db4a-4f4d-96c7-f0a7f1128d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1806631589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a823d723-513f-4ead-be3d-f4f032ecf858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:48Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9482a3ba-9eb6-45c5-8c39-d1cb309033f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9482a3ba-9eb6-45c5-8c39-d1cb309033f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ca5333-014f-4256-b505-c0629d347fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ca5333-014f-4256-b505-c0629d347fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a823d723-513f-4ead-be3d-f4f032ecf858', 'volume_name': 'volume-a823d723-513f-4ead-be3d-f4f032ecf858', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2375a6e9-5054-408b-968d-5d5b3daf2e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2375a6e9-5054-408b-968d-5d5b3daf2e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05735e3b-0ac3-459c-83b7-dd0306935f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:47 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume a823d723-513f-4ead-be3d-f4f032ecf858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a823d723-513f-4ead-be3d-f4f032ecf858', 'volume_size': 1} Sep 10 20:19:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:48 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 1073741824" returned: 0 in 0.510s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:48 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 Sep 10 20:19:48 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (bd47b51f-9832-4a44-9903-73fb4a07f20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e8c0da-3835-4555-b432-caaa8c05a8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e8c0da-3835-4555-b432-caaa8c05a8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696588079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d781a23d-174e-4821-b73c-66f79718dc9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:48Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6754d17b-6370-4996-be11-e935710c0510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6754d17b-6370-4996-be11-e935710c0510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6e8e99-0190-47f8-a285-7398149c12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6e8e99-0190-47f8-a285-7398149c12c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd781a23d-174e-4821-b73c-66f79718dc9a', 'volume_name': 'volume-d781a23d-174e-4821-b73c-66f79718dc9a', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b340537-1c6a-4095-8d9e-b0919d12a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b340537-1c6a-4095-8d9e-b0919d12a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c20dc0-657a-4d02-8b9b-9b7f7025a62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume d781a23d-174e-4821-b73c-66f79718dc9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d781a23d-174e-4821-b73c-66f79718dc9a', 'volume_size': 1} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:48 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5" returned: 0 in 0.290s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.946s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-266328350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91ed665-68d7-4075-bc79-1ee455704baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:47Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Creating volume d91ed665-68d7-4075-bc79-1ee455704baf {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:48 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c9c07d-2177-4e71-9bfc-9cac365c3e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf 1073741824 Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6373f332-fabb-4f4d-b393-bc4863d69653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:48 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 (0b967f7b-0875-4fcb-9b1b-195c891e35d5): created successfully Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6373f332-fabb-4f4d-b393-bc4863d69653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (b4b9de73-5c5b-4f32-8608-10c00fcff8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6f1831f3-d972-4421-af1a-45dd457defa8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created volume successfully. Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Flow 'volume_create_manager' (034cbe0c-ebef-4d05-8aca-64a77f9f8b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd28e17-ee23-4066-81af-a482835da10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd28e17-ee23-4066-81af-a482835da10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1707149105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a3f0d6-48e7-49d6-ac9a-b8fc24703016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90a0a59f044dfcb018ef49b2c023b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:48Z,use_quota=True,user_id='6c1065fbd25c427babb4c9ca6c2cd8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65101f4-4438-48d4-9e6b-16900a2e4df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65101f4-4438-48d4-9e6b-16900a2e4df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe7d249-4cbe-4aca-8e32-cf7329697f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe7d249-4cbe-4aca-8e32-cf7329697f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a3f0d6-48e7-49d6-ac9a-b8fc24703016', 'volume_name': 'volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9181ebf0-de5d-4940-99a6-ed0e26b83c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9181ebf0-de5d-4940-99a6-ed0e26b83c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5beb78-2a53-43ab-a44c-1da1211e3e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:48 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Volume 99a3f0d6-48e7-49d6-ac9a-b8fc24703016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016', 'volume_size': 1} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:48 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf 1073741824" returned: 0 in 0.404s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:48 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf Sep 10 20:19:48 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:49 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf" returned: 0 in 0.237s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.276s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1806631589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a823d723-513f-4ead-be3d-f4f032ecf858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:48Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Creating volume a823d723-513f-4ead-be3d-f4f032ecf858 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:49 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6599b53c-86f8-443e-a48e-0d7fed3f36fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91ed665-68d7-4075-bc79-1ee455704baf', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241bfbab-8409-4419-b5b3-f8089b8c51e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:49 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858 1073741824 Sep 10 20:19:49 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:49 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume volume-d91ed665-68d7-4075-bc79-1ee455704baf (d91ed665-68d7-4075-bc79-1ee455704baf): created successfully Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241bfbab-8409-4419-b5b3-f8089b8c51e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (824f643b-9e31-475b-bbcb-8d55acce0bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-7399d814-8a06-4e1f-92e6-4a8b0bd5f33d tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created volume successfully. Sep 10 20:19:49 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858 1073741824" returned: 0 in 0.426s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:49 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858 Sep 10 20:19:49 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:49 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858" returned: 0 in 0.271s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.550s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696588079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d781a23d-174e-4821-b73c-66f79718dc9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56266d8c72148d8b256cca9293add4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:48Z,use_quota=True,user_id='f7f85c25e9644530944940ebea04e44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Creating volume d781a23d-174e-4821-b73c-66f79718dc9a {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:49 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05735e3b-0ac3-459c-83b7-dd0306935f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a823d723-513f-4ead-be3d-f4f032ecf858', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e99a225-8ff7-4fdc-9c92-4b4da7be666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:49 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a 1073741824 Sep 10 20:19:49 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:49 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume volume-a823d723-513f-4ead-be3d-f4f032ecf858 (a823d723-513f-4ead-be3d-f4f032ecf858): created successfully Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e99a225-8ff7-4fdc-9c92-4b4da7be666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (3f7a6721-e3b2-4ae6-ab84-0f8284d35228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-364f3ed5-bd05-4991-991e-c38ae331e11e tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created volume successfully. Sep 10 20:19:50 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a 1073741824" returned: 0 in 0.427s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:50 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a Sep 10 20:19:50 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:50 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a" returned: 0 in 0.258s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1707149105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a3f0d6-48e7-49d6-ac9a-b8fc24703016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90a0a59f044dfcb018ef49b2c023b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:48Z,use_quota=True,user_id='6c1065fbd25c427babb4c9ca6c2cd8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Creating volume 99a3f0d6-48e7-49d6-ac9a-b8fc24703016 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:50 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:50 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 1073741824 Sep 10 20:19:50 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c20dc0-657a-4d02-8b9b-9b7f7025a62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d781a23d-174e-4821-b73c-66f79718dc9a', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48381259-e4d9-4d4a-a835-78ff6d06aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:50 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Volume volume-d781a23d-174e-4821-b73c-66f79718dc9a (d781a23d-174e-4821-b73c-66f79718dc9a): created successfully Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48381259-e4d9-4d4a-a835-78ff6d06aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Flow 'volume_create_manager' (bd47b51f-9832-4a44-9903-73fb4a07f20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:50 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-74392889-ca9d-4449-b229-8ad2334ff3a7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created volume successfully. Sep 10 20:19:50 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 1073741824" returned: 0 in 0.390s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=182,cinder:SELECT=125,cinder:DELETE=20,cinder:INSERT=43 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:19:50 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=136,cinder:UPDATE=174,cinder:INSERT=38,cinder:DELETE=14 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:51 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 Sep 10 20:19:51 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:51 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016" returned: 0 in 0.232s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5beb78-2a53-43ab-a44c-1da1211e3e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bdd8f2-5121-494f-b3ca-c8f8945d0910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Volume volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 (99a3f0d6-48e7-49d6-ac9a-b8fc24703016): created successfully Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bdd8f2-5121-494f-b3ca-c8f8945d0910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Flow 'volume_create_manager' (034cbe0c-ebef-4d05-8aca-64a77f9f8b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ecf10de8-d21c-4f3f-aa30-36f4ab416a0d tempest-VolumesTransfersV355Test-403352661 None] Created volume successfully. Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-d781a23d-174e-4821-b73c-66f79718dc9a-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-d781a23d-174e-4821-b73c-66f79718dc9a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-quobyte-d781a23d-174e-4821-b73c-66f79718dc9a" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-d781a23d-174e-4821-b73c-66f79718dc9a" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00ced12-0e0f-48b4-93ec-b8b6b6c02af3]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:51 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a Sep 10 20:19:51 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:51 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a" returned: 0 in 0.369s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:52 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a Sep 10 20:19:52 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:52 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d781a23d-174e-4821-b73c-66f79718dc9a" returned: 0 in 0.252s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-d781a23d-174e-4821-b73c-66f79718dc9a" released by "delete_volume" :: held 0.670s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:52 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9f1089f8-9b11-422f-8599-f8f73517ca49 tempest-VolumesTransfersV355Test-550732552 None] Transfer volume completed successfully. Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created reservations ['54ba1eee-d1a2-4d21-b945-0ccc787925a3', 'da35f196-7b2e-455e-a2af-4a84c39dd1c1', 'a1e9d5f5-5b3c-483e-81ab-a19b51e45246', '2c8bb3b2-667d-4e15-b28a-80b29d47519f'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:52 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:52 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:52 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.252s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:52 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Deleted volume successfully. Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-a823d723-513f-4ead-be3d-f4f032ecf858-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8a603acf-43cd-461f-8579-b217e214a074 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-d781a23d-174e-4821-b73c-66f79718dc9a-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-a823d723-513f-4ead-be3d-f4f032ecf858-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-quobyte-a823d723-513f-4ead-be3d-f4f032ecf858" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-a823d723-513f-4ead-be3d-f4f032ecf858" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f17839-f9a4-4384-b3e6-fdd66d09ceb5]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Acquiring lock "cinder-99a3f0d6-48e7-49d6-ac9a-b8fc24703016-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Lock "cinder-99a3f0d6-48e7-49d6-ac9a-b8fc24703016-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Acquiring lock "cinder-quobyte-99a3f0d6-48e7-49d6-ac9a-b8fc24703016" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Lock "cinder-quobyte-99a3f0d6-48e7-49d6-ac9a-b8fc24703016" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:52 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858 Sep 10 20:19:52 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[421e2aa0-2b25-428e-a578-08a58e23c4a6]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:53 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 Sep 10 20:19:53 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:53 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858" returned: 0 in 0.373s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:53 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858 Sep 10 20:19:53 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:53 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016" returned: 0 in 0.339s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:53 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016 Sep 10 20:19:53 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:53 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a823d723-513f-4ead-be3d-f4f032ecf858" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-a823d723-513f-4ead-be3d-f4f032ecf858" released by "delete_volume" :: held 0.669s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created reservations ['0718469e-7671-4986-9407-7efcf9299d7c', '95455232-8e53-4a7f-bfdd-6301c23fc3fc', '04d4161b-b6e4-4a19-aadd-c20ce481900c', '9e265044-b035-4ae2-a410-b38eeb78da4c'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:53 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99a3f0d6-48e7-49d6-ac9a-b8fc24703016" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Lock "cinder-quobyte-99a3f0d6-48e7-49d6-ac9a-b8fc24703016" released by "delete_volume" :: held 0.632s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:53 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:53 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Created reservations ['4e8a95e7-2a91-4a91-b957-b7862f4384d3', 'df693163-7a11-4b54-91c0-b5c34849a5c1', '2dd0f3f3-2ea1-4dac-a657-6d7cfb7fd02d', '37102053-5e48-43f4-bb2d-5817689c1a3d'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:53 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:53 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:53 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.247s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Deleted volume successfully. Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f4da15d-f6d8-40c6-9699-6680eaae57dd tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-a823d723-513f-4ead-be3d-f4f032ecf858-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-d91ed665-68d7-4075-bc79-1ee455704baf-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-d91ed665-68d7-4075-bc79-1ee455704baf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-quobyte-d91ed665-68d7-4075-bc79-1ee455704baf" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-d91ed665-68d7-4075-bc79-1ee455704baf" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:53 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.279s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Deleted volume successfully. Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f331140b-64ef-42e0-ae0c-78460fc6de10]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-277f8b36-6f30-48ad-86eb-c2c7df565997 tempest-VolumesTransfersV355Test-1580127704 None] Lock "cinder-99a3f0d6-48e7-49d6-ac9a-b8fc24703016-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:54 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf Sep 10 20:19:54 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:54 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf" returned: 0 in 0.385s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:54 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf Sep 10 20:19:54 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Flow 'volume_create_manager' (682d2727-d6d2-4914-97ca-26ba57823e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec297250-d7f6-472f-9b12-ac0b26f73b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec297250-d7f6-472f-9b12-ac0b26f73b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-50590320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb8ac93-f692-49ae-8137-dc47767a8ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90a0a59f044dfcb018ef49b2c023b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:55Z,use_quota=True,user_id='6c1065fbd25c427babb4c9ca6c2cd8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0c2cc2-ba1e-4da4-af81-efc41046f37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0c2cc2-ba1e-4da4-af81-efc41046f37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a515cd-e251-47b4-8c30-fcdd17c66f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:54 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a515cd-e251-47b4-8c30-fcdd17c66f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb8ac93-f692-49ae-8137-dc47767a8ddd', 'volume_name': 'volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c88c391-20bf-4538-b114-1a27e068c570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c88c391-20bf-4538-b114-1a27e068c570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259d1962-dfed-42e8-b7c6-8fd6b017d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:54 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Volume cfb8ac93-f692-49ae-8137-dc47767a8ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd', 'volume_size': 1} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-50590320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb8ac93-f692-49ae-8137-dc47767a8ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec90a0a59f044dfcb018ef49b2c023b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:19:55Z,use_quota=True,user_id='6c1065fbd25c427babb4c9ca6c2cd8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Creating volume cfb8ac93-f692-49ae-8137-dc47767a8ddd {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:19:54 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d91ed665-68d7-4075-bc79-1ee455704baf" returned: 0 in 0.297s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-d91ed665-68d7-4075-bc79-1ee455704baf" released by "delete_volume" :: held 0.725s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:54 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd 1073741824 Sep 10 20:19:54 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created reservations ['2e07be96-812d-44b4-98ac-adf605869214', 'e3570399-c940-43d5-900a-96d8b7e432c0', 'b8e38728-8198-4316-a667-99d99103b4e6', 'ff1387b4-c7a6-42f8-9b2a-6270edb03005'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:54 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:54 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:55 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.262s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-0b967f7b-0875-4fcb-9b1b-195c891e35d5-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:55 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Deleted volume successfully. Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-0b967f7b-0875-4fcb-9b1b-195c891e35d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-249664ba-3b7a-4485-9372-f5cfa93951f7 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-d91ed665-68d7-4075-bc79-1ee455704baf-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:55 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd 1073741824" returned: 0 in 0.458s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-quobyte-0b967f7b-0875-4fcb-9b1b-195c891e35d5" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-0b967f7b-0875-4fcb-9b1b-195c891e35d5" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd2c6ea-02ac-499b-8065-93610fe4c1ff]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:55 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd Sep 10 20:19:55 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:55 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 Sep 10 20:19:55 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:55 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd" returned: 0 in 0.256s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259d1962-dfed-42e8-b7c6-8fd6b017d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f09881-a8a6-4814-8149-88d225fb47ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:19:55 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Volume volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd (cfb8ac93-f692-49ae-8137-dc47767a8ddd): created successfully Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f09881-a8a6-4814-8149-88d225fb47ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Flow 'volume_create_manager' (682d2727-d6d2-4914-97ca-26ba57823e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:19:55 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c7d153d0-8091-461a-9917-b11d77023a19 tempest-VolumesTransfersV355Test-403352661 None] Created volume successfully. Sep 10 20:19:55 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5" returned: 0 in 0.365s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:55 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5 Sep 10 20:19:55 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:55 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-0b967f7b-0875-4fcb-9b1b-195c891e35d5" returned: 0 in 0.237s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-0b967f7b-0875-4fcb-9b1b-195c891e35d5" released by "delete_volume" :: held 0.640s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created reservations ['eaa84307-fb60-467a-9edb-686834661774', 'bb113a2d-155c-4011-9fc2-3a9e7c1dd3b7', 'c6492147-de86-4828-8220-f188348ee734', 'f9b08b28-c0c7-4885-8601-0b406a4c061a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:55 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:55 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:56 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.233s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:56 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Deleted volume successfully. Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bd8d961d-ad31-4638-a4a4-b11b8a4f7da8 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-0b967f7b-0875-4fcb-9b1b-195c891e35d5-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-b374ecea-009d-4dbc-9475-03f1e10e31e4-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-b374ecea-009d-4dbc-9475-03f1e10e31e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-quobyte-b374ecea-009d-4dbc-9475-03f1e10e31e4" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-b374ecea-009d-4dbc-9475-03f1e10e31e4" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9c483a-fd90-47b8-9d8a-f4cb20338ae0]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:56 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 Sep 10 20:19:56 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:56 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4" returned: 0 in 0.356s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:56 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4 Sep 10 20:19:56 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Acquiring lock "cinder-cfb8ac93-f692-49ae-8137-dc47767a8ddd-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Lock "cinder-cfb8ac93-f692-49ae-8137-dc47767a8ddd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Acquiring lock "cinder-quobyte-cfb8ac93-f692-49ae-8137-dc47767a8ddd" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Lock "cinder-quobyte-cfb8ac93-f692-49ae-8137-dc47767a8ddd" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac65074-1849-432b-ab13-aa2133cce7a9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:57 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b374ecea-009d-4dbc-9475-03f1e10e31e4" returned: 0 in 0.259s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-b374ecea-009d-4dbc-9475-03f1e10e31e4" released by "delete_volume" :: held 0.652s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:57 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd Sep 10 20:19:57 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created reservations ['389ae977-e16e-4812-8703-0f418ae5ef15', '23774432-d8b4-4b95-b7c3-07f342b953a9', '7248d4f3-4e77-4e14-a510-6db717a3c6e0', '629343c7-5d16-4976-aa36-f96bcd15a3c0'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:57 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:57 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:57 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd" returned: 0 in 0.353s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:57 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd Sep 10 20:19:57 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:57 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.254s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Deleted volume successfully. Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b164cce0-8e36-4a68-a1b4-d3003eb7dc56 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-b374ecea-009d-4dbc-9475-03f1e10e31e4-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-f1e325a3-a49f-41ff-a867-70197e4b0771-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-f1e325a3-a49f-41ff-a867-70197e4b0771-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "cinder-quobyte-f1e325a3-a49f-41ff-a867-70197e4b0771" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-f1e325a3-a49f-41ff-a867-70197e4b0771" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:19:57 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-cfb8ac93-f692-49ae-8137-dc47767a8ddd" returned: 0 in 0.280s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f3620a-09a0-4ce6-92a0-6c748d4776bf]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Lock "cinder-quobyte-cfb8ac93-f692-49ae-8137-dc47767a8ddd" released by "delete_volume" :: held 0.676s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Created reservations ['86c5356b-f3c7-4c67-94b6-41f073d832f7', '79e5cafc-0c0e-4d26-a08f-50ecd8c9cfcd', '7c4c3c5d-8f7d-4ce5-9571-b2d6fd2d7085', '3e831d7f-87fa-4ea0-8dbd-910fcd14af98'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:57 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771 Sep 10 20:19:57 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:57 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:57 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:58 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.246s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:58 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Deleted volume successfully. Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771" returned: 0 in 0.393s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:58 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771 Sep 10 20:19:58 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f3258b46-ff37-47d5-ac9b-d359ff61bc52 tempest-VolumesTransfersV355Test-1580127704 None] Lock "cinder-cfb8ac93-f692-49ae-8137-dc47767a8ddd-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:58 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f1e325a3-a49f-41ff-a867-70197e4b0771" returned: 0 in 0.260s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-quobyte-f1e325a3-a49f-41ff-a867-70197e4b0771" released by "delete_volume" :: held 0.696s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Created reservations ['2eb1ef45-dc39-48ea-9d92-e3e4a3f3d060', '10326603-4097-4577-b485-26193894c3f8', 'ba1b8167-ece2-487d-9911-52401860d996', 'fbf203c8-7288-49d8-b0af-7c33b4997d69'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:19:58 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:19:58 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:19:58 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.292s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:19:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Deleted volume successfully. Sep 10 20:19:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f48bb518-daeb-41f3-bc2e-513f5f8129d2 tempest-CreateVolumesFromSourceVolumeTest-1448074236 None] Lock "cinder-f1e325a3-a49f-41ff-a867-70197e4b0771-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:20:08 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=40,cinder:INSERT=17,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:20:08 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=71,cinder:SELECT=46,cinder:INSERT=17,cinder:DELETE=5 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:20:20 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:20:20 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:20:20 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.320s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:20:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Flow 'volume_create_manager' (0d52d4f8-c7eb-4b25-85be-5610b1129cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3209a46b-4dfb-440e-91d1-e0f41da09144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3209a46b-4dfb-440e-91d1-e0f41da09144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1239559794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b455ab96-15ec-47f1-bc24-fabeb11989ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a16d3e342d74fcdbd8bf29c71b698c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:20:21Z,use_quota=True,user_id='25bf7eff543d41e79a2edf300e303f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfe46e8-6cf9-437f-9b56-b527ece485ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfe46e8-6cf9-437f-9b56-b527ece485ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55fb17c-9972-492e-817f-ae62ecb98373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55fb17c-9972-492e-817f-ae62ecb98373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b455ab96-15ec-47f1-bc24-fabeb11989ac', 'volume_name': 'volume-b455ab96-15ec-47f1-bc24-fabeb11989ac', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a97ab8-4feb-4c3b-bedd-9ba9ed5550bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a97ab8-4feb-4c3b-bedd-9ba9ed5550bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60cad58-316b-42e2-b7ac-baf83d945e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:21 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Volume b455ab96-15ec-47f1-bc24-fabeb11989ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b455ab96-15ec-47f1-bc24-fabeb11989ac', 'volume_size': 1} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1239559794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b455ab96-15ec-47f1-bc24-fabeb11989ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a16d3e342d74fcdbd8bf29c71b698c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:20:21Z,use_quota=True,user_id='25bf7eff543d41e79a2edf300e303f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Creating volume b455ab96-15ec-47f1-bc24-fabeb11989ac {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:20:21 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:20:21 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac 1073741824 Sep 10 20:20:21 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Flow 'volume_create_manager' (17ed6aee-385c-4e10-b1a6-04fa76fe8f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78894d31-3821-40b5-8320-bb1e0c401109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78894d31-3821-40b5-8320-bb1e0c401109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1006601422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d92091b-e97d-42af-b6ac-ad3e5d4a0de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a16d3e342d74fcdbd8bf29c71b698c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:20:22Z,use_quota=True,user_id='25bf7eff543d41e79a2edf300e303f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfc6c18-43f1-4c3a-b8b9-4a5ebb9a1e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfc6c18-43f1-4c3a-b8b9-4a5ebb9a1e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1face36e-9b41-4c2b-a334-64692976a5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1face36e-9b41-4c2b-a334-64692976a5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d92091b-e97d-42af-b6ac-ad3e5d4a0de9', 'volume_name': 'volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e404eab-7b48-414c-bdfc-a5d5d23c7e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e404eab-7b48-414c-bdfc-a5d5d23c7e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7000e316-fa59-4fe5-86d4-ab28ba45c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:22 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Volume 7d92091b-e97d-42af-b6ac-ad3e5d4a0de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9', 'volume_size': 1} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:20:22 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac 1073741824" returned: 0 in 0.476s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:20:22 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac Sep 10 20:20:22 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:20:22 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac" returned: 0 in 0.257s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1006601422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d92091b-e97d-42af-b6ac-ad3e5d4a0de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a16d3e342d74fcdbd8bf29c71b698c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:20:22Z,use_quota=True,user_id='25bf7eff543d41e79a2edf300e303f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Creating volume 7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:20:22 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60cad58-316b-42e2-b7ac-baf83d945e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b455ab96-15ec-47f1-bc24-fabeb11989ac', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9715a-e2f1-49a4-bace-883a9a10a8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:22 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 1073741824 Sep 10 20:20:22 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:20:22 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Volume volume-b455ab96-15ec-47f1-bc24-fabeb11989ac (b455ab96-15ec-47f1-bc24-fabeb11989ac): created successfully Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df9715a-e2f1-49a4-bace-883a9a10a8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Flow 'volume_create_manager' (0d52d4f8-c7eb-4b25-85be-5610b1129cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:20:22 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1f0d329f-7e0b-4d0d-8613-57ae4c5c3148 tempest-TestServerVolumeAttachmentScenario-507142065 None] Created volume successfully. Sep 10 20:20:22 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 1073741824" returned: 0 in 0.487s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:20:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:20:22 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 Sep 10 20:20:22 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:20:23 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Sep 10 20:20:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9" returned: 0 in 0.272s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:20:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:20:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:20:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7000e316-fa59-4fe5-86d4-ab28ba45c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b83c30-56be-45b5-be3a-8e20f4925e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:20:23 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Volume volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 (7d92091b-e97d-42af-b6ac-ad3e5d4a0de9): created successfully Sep 10 20:20:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b83c30-56be-45b5-be3a-8e20f4925e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:20:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Flow 'volume_create_manager' (17ed6aee-385c-4e10-b1a6-04fa76fe8f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:20:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8eb26a24-df4b-468b-a13a-f7c625e98b88 tempest-TestServerVolumeAttachmentScenario-507142065 None] Created volume successfully. Sep 10 20:20:33 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:20:33 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:DELETE=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:20:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-e7c2de63-c8ea-47ed-9136-b6a0ca45b90b req-b5fa74d2-5909-442a-a49e-d661b92ed98a tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:20:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-e7c2de63-c8ea-47ed-9136-b6a0ca45b90b req-b5fa74d2-5909-442a-a49e-d661b92ed98a tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:20:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-e7c2de63-c8ea-47ed-9136-b6a0ca45b90b req-b5fa74d2-5909-442a-a49e-d661b92ed98a tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:20:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-e7c2de63-c8ea-47ed-9136-b6a0ca45b90b req-b5fa74d2-5909-442a-a49e-d661b92ed98a tempest-TestServerVolumeAttachmentScenario-507142065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-b455ab96-15ec-47f1-bc24-fabeb11989ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86342fca-6255-4ed4-9a19-61904fdda43d', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:20:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-e7c2de63-c8ea-47ed-9136-b6a0ca45b90b req-b5fa74d2-5909-442a-a49e-d661b92ed98a tempest-TestServerVolumeAttachmentScenario-507142065 None] attachment_update completed successfully. Sep 10 20:20:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-46e009bb-d509-4c69-a814-623929c88952 req-ba416c09-e2e7-4e17-b8d5-353e0997dcd7 tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:20:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-46e009bb-d509-4c69-a814-623929c88952 req-ba416c09-e2e7-4e17-b8d5-353e0997dcd7 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:20:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-46e009bb-d509-4c69-a814-623929c88952 req-ba416c09-e2e7-4e17-b8d5-353e0997dcd7 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:20:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-46e009bb-d509-4c69-a814-623929c88952 req-ba416c09-e2e7-4e17-b8d5-353e0997dcd7 tempest-TestServerVolumeAttachmentScenario-507142065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22a153a7-10ef-4278-9220-2e00fd1ffc7e', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:20:56 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-46e009bb-d509-4c69-a814-623929c88952 req-ba416c09-e2e7-4e17-b8d5-353e0997dcd7 tempest-TestServerVolumeAttachmentScenario-507142065 None] attachment_update completed successfully. Sep 10 20:20:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-6e51dc42-3cd9-480e-9fa6-894349bb77e4 req-af3b354d-d72a-4d10-9b68-cd155bc0c5b1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Terminate volume connection completed successfully. Sep 10 20:20:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-6e51dc42-3cd9-480e-9fa6-894349bb77e4 req-af3b354d-d72a-4d10-9b68-cd155bc0c5b1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Deleting attachment 22a153a7-10ef-4278-9220-2e00fd1ffc7e. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:20:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-96ec974f-e7c5-4e20-a3aa-bffeaed62577 req-d20dbc6e-8935-4569-a3bf-88cf3e38a248 tempest-TestServerVolumeAttachmentScenario-507142065 None] Terminate volume connection completed successfully. Sep 10 20:20:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-96ec974f-e7c5-4e20-a3aa-bffeaed62577 req-d20dbc6e-8935-4569-a3bf-88cf3e38a248 tempest-TestServerVolumeAttachmentScenario-507142065 None] Deleting attachment 86342fca-6255-4ed4-9a19-61904fdda43d. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "cinder-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "cinder-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "cinder-quobyte-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "cinder-quobyte-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[31347c7f-7190-48c4-8867-6359ff1ac3a6]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:04 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 Sep 10 20:21:04 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:04 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9" returned: 0 in 0.358s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:04 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9 Sep 10 20:21:04 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:04 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9" returned: 0 in 0.228s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "cinder-quobyte-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9" released by "delete_volume" :: held 0.622s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:21:04 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Created reservations ['2b1e6426-85e5-4eac-bf80-b727e2c08b9a', '624659ad-3ad7-4fa7-bcc0-d0a54d1743e4', 'cf7e0987-80bd-4199-b3c6-b97b6077710e', '423593dc-c048-413d-9e9e-c01ca9b3b263'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:05 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:21:05 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:05 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.228s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:21:05 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Deleted volume successfully. Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2c109e6b-b56d-4d3a-9756-10d965ac9ac1 tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "cinder-7d92091b-e97d-42af-b6ac-ad3e5d4a0de9-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "cinder-b455ab96-15ec-47f1-bc24-fabeb11989ac-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "cinder-b455ab96-15ec-47f1-bc24-fabeb11989ac-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "cinder-quobyte-b455ab96-15ec-47f1-bc24-fabeb11989ac" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "cinder-quobyte-b455ab96-15ec-47f1-bc24-fabeb11989ac" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ed9547-8ec8-4033-a9b5-64796e4523a3]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:05 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac Sep 10 20:21:05 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:05 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac" returned: 0 in 0.345s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:05 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac Sep 10 20:21:05 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:06 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b455ab96-15ec-47f1-bc24-fabeb11989ac" returned: 0 in 0.241s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "cinder-quobyte-b455ab96-15ec-47f1-bc24-fabeb11989ac" released by "delete_volume" :: held 0.620s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Created reservations ['58c16734-6ec3-43f4-ba23-8cd122eb9037', 'b2e435e1-da01-4c51-b85c-6eff81f495e6', 'eda13fc6-37eb-4b04-b867-3826c7a419cb', '935d6be3-c363-494b-b58c-01f98d28731e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:06 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:21:06 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:06 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.241s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:21:06 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Deleted volume successfully. Sep 10 20:21:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fa7d2ba0-fb5d-4023-aae1-ae62fd7d3ecd tempest-TestServerVolumeAttachmentScenario-507142065 None] Lock "cinder-b455ab96-15ec-47f1-bc24-fabeb11989ac-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:21:16 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=23,cinder:UPDATE=17,cinder:INSERT=4 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:21:16 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=27,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:20 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:21:20 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:20 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.312s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:21:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:21:38 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:21:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Flow 'volume_create_manager' (cbdafa53-6dc0-40ae-8088-780ece2123a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:21:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f08f899-9efc-4687-91dc-c957da0dfe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:21:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f08f899-9efc-4687-91dc-c957da0dfe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-716131194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69241808-d133-4920-b3bc-171d6cfbda60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0298e8eeb24f50b2682d04f7a0ac64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:21:39Z,use_quota=True,user_id='a86520654d904b9ab555602d0fc028b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:21:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc19e36b-cb66-44e7-8de2-1fbf0b05f0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:21:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc19e36b-cb66-44e7-8de2-1fbf0b05f0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:21:38 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d234a5-7afa-4009-be68-109b172920d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:21:38 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d234a5-7afa-4009-be68-109b172920d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69241808-d133-4920-b3bc-171d6cfbda60', 'volume_name': 'volume-69241808-d133-4920-b3bc-171d6cfbda60', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b50f4bc-b9c6-4095-8099-1150e148a4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b50f4bc-b9c6-4095-8099-1150e148a4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a589737-4332-4c9f-9997-92fed84c49c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:21:39 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Volume 69241808-d133-4920-b3bc-171d6cfbda60: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69241808-d133-4920-b3bc-171d6cfbda60', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Trying to clone 69241808-d133-4920-b3bc-171d6cfbda60 from image c78ee229-c276-4323-b914-d91a23a49bd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:21:39 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Image download 20.69 MB at 20.69 MB/s Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[03058f8d-16ad-4158-b0aa-8d9e3050cbcf]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:39 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD Sep 10 20:21:39 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:39 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 is fetched for user a86520654d904b9ab555602d0fc028b3. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbfaf71-ce62-420b-a736-8e1b683b4b49]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:21:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:39 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD Sep 10 20:21:39 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:40 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-716131194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69241808-d133-4920-b3bc-171d6cfbda60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0298e8eeb24f50b2682d04f7a0ac64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:21:39Z,use_quota=True,user_id='a86520654d904b9ab555602d0fc028b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Creating volume 69241808-d133-4920-b3bc-171d6cfbda60 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:21:40 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:40 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 1073741824 Sep 10 20:21:40 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:40 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 1073741824" returned: 0 in 0.398s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:40 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 Sep 10 20:21:40 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:40 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60" returned: 0 in 0.247s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Attempting download of c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume 69241808-d133-4920-b3bc-171d6cfbda60. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b78b3f-ef36-4850-a0d4-9ff62d9a8373]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:21:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_tuch0fsj {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:40 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_tuch0fsj Sep 10 20:21:40 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:41 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_tuch0fsj" returned: 0 in 0.333s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_tuch0fsj {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:41 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_tuch0fsj Sep 10 20:21:41 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:41 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_tuch0fsj" returned: 1 in 0.317s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78ee229-c276-4323-b914-d91a23a49bd6_tuch0fsj' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:21:41 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6542a649-70ea-45cc-93fa-509386617333]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:21:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:41 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD Sep 10 20:21:41 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:41 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:41 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] c78ee229-c276-4323-b914-d91a23a49bd6 was qcow2, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:21:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:41 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 Sep 10 20:21:41 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:43 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60" returned: 0 in 1.488s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c78ee229-c276-4323-b914-d91a23a49bd6_hmj61cjodevstack@QuobyteHD, size 112.00 MB, duration 1.49 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:21:43 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Converted 112.00 MB image at 75.23 MB/s Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:21:43 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 1G Sep 10 20:21:43 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:21:43 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 1G" returned: 0 in 0.301s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Downloaded image c78ee229-c276-4323-b914-d91a23a49bd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}])) to volume 69241808-d133-4920-b3bc-171d6cfbda60 successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Temporary image c78ee229-c276-4323-b914-d91a23a49bd6 for user a86520654d904b9ab555602d0fc028b3 is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Marking volume 69241808-d133-4920-b3bc-171d6cfbda60 as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Copying metadata from image c78ee229-c276-4323-b914-d91a23a49bd6 to 69241808-d133-4920-b3bc-171d6cfbda60. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Creating volume glance metadata for volume 69241808-d133-4920-b3bc-171d6cfbda60 backed by image c78ee229-c276-4323-b914-d91a23a49bd6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a589737-4332-4c9f-9997-92fed84c49c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69241808-d133-4920-b3bc-171d6cfbda60', 'volume_size': 1, 'image_id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78ee229-c276-4323-b914-d91a23a49bd6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1adf785d0ef1429487a1e5355bb6a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c78ee229-c276-4323-b914-d91a23a49bd6', 'created_at': datetime.datetime(2026, 9, 10, 17, 58, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 17, 58, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78ee229-c276-4323-b914-d91a23a49bd6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6beb4ce-0957-40f9-b13a-705854047b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:21:43 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Volume volume-69241808-d133-4920-b3bc-171d6cfbda60 (69241808-d133-4920-b3bc-171d6cfbda60): created successfully Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6beb4ce-0957-40f9-b13a-705854047b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:21:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Flow 'volume_create_manager' (cbdafa53-6dc0-40ae-8088-780ece2123a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:21:43 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-603259f2-515c-4efa-a08b-06d72710c89c tempest-TestShelveInstance-552922568 None] Created volume successfully. Sep 10 20:21:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-3b4a462e-f13f-4a32-bfd3-5e46b40910bf req-6631f36b-8cae-4c9b-80d8-a527ea6f3860 tempest-TestShelveInstance-552922568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:21:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-3b4a462e-f13f-4a32-bfd3-5e46b40910bf req-6631f36b-8cae-4c9b-80d8-a527ea6f3860 tempest-TestShelveInstance-552922568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:21:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-3b4a462e-f13f-4a32-bfd3-5e46b40910bf req-6631f36b-8cae-4c9b-80d8-a527ea6f3860 tempest-TestShelveInstance-552922568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:21:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-3b4a462e-f13f-4a32-bfd3-5e46b40910bf req-6631f36b-8cae-4c9b-80d8-a527ea6f3860 tempest-TestShelveInstance-552922568 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-69241808-d133-4920-b3bc-171d6cfbda60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dfb6a8d-dbb8-4875-91e1-5be478bd0641', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:21:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-3b4a462e-f13f-4a32-bfd3-5e46b40910bf req-6631f36b-8cae-4c9b-80d8-a527ea6f3860 tempest-TestShelveInstance-552922568 None] attachment_update completed successfully. Sep 10 20:21:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:INSERT=7 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:21:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=8,cinder:SELECT=14,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:22:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-dd01e7be-d74a-4aeb-879b-5b2167f848c2 req-2b259fd6-c325-4b2d-9c88-60c1352531d7 tempest-TestShelveInstance-552922568 None] Terminate volume connection completed successfully. Sep 10 20:22:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-dd01e7be-d74a-4aeb-879b-5b2167f848c2 req-2b259fd6-c325-4b2d-9c88-60c1352531d7 tempest-TestShelveInstance-552922568 None] Deleting attachment 7dfb6a8d-dbb8-4875-91e1-5be478bd0641. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:22:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-9eb24936-03f4-4ad8-897b-87b1ade8d5db req-9e273c59-0f95-40e1-ba2e-625142129f14 tempest-TestShelveInstance-552922568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:22:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-9eb24936-03f4-4ad8-897b-87b1ade8d5db req-9e273c59-0f95-40e1-ba2e-625142129f14 tempest-TestShelveInstance-552922568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:22:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-9eb24936-03f4-4ad8-897b-87b1ade8d5db req-9e273c59-0f95-40e1-ba2e-625142129f14 tempest-TestShelveInstance-552922568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:22:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-9eb24936-03f4-4ad8-897b-87b1ade8d5db req-9e273c59-0f95-40e1-ba2e-625142129f14 tempest-TestShelveInstance-552922568 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-69241808-d133-4920-b3bc-171d6cfbda60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c89422b-aa66-4260-8c08-7f27c5c5f119', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:22:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-9eb24936-03f4-4ad8-897b-87b1ade8d5db req-9e273c59-0f95-40e1-ba2e-625142129f14 tempest-TestShelveInstance-552922568 None] attachment_update completed successfully. Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:22:20 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:22:20 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:22:20 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:22:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:22:29 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:22:29 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:22:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3a8788d0-fe3c-4252-b99d-95b51647401a tempest-TestShelveInstance-552922568 None] Terminate volume connection completed successfully. Sep 10 20:22:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3a8788d0-fe3c-4252-b99d-95b51647401a tempest-TestShelveInstance-552922568 None] Deleting attachment 2c89422b-aa66-4260-8c08-7f27c5c5f119. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:22:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Acquiring lock "cinder-69241808-d133-4920-b3bc-171d6cfbda60-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:22:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Lock "cinder-69241808-d133-4920-b3bc-171d6cfbda60-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:22:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Acquiring lock "cinder-quobyte-69241808-d133-4920-b3bc-171d6cfbda60" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:22:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Lock "cinder-quobyte-69241808-d133-4920-b3bc-171d6cfbda60" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8532e2b-0eaf-4da4-ac56-0f18815650a7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:22:47 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 Sep 10 20:22:47 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:22:47 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:22:47 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60 Sep 10 20:22:47 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:22:47 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-69241808-d133-4920-b3bc-171d6cfbda60" returned: 0 in 0.237s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Lock "cinder-quobyte-69241808-d133-4920-b3bc-171d6cfbda60" released by "delete_volume" :: held 0.655s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG cinder.quota [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Created reservations ['2ec236b8-19bb-4203-ae60-dec586674fcd', '9cd8a66a-5ab0-4146-b3ae-f59258921d89', '6beaab09-2906-4570-9b7d-53caf263c16b', '9b775b3b-ab2d-4a91-bc2a-c59780b080b2'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:22:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:22:47 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:22:47 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:22:48 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 10 20:22:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.261s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:22:48 devstack cinder-volume[88137]: DEBUG cinder.manager [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:22:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Deleted volume successfully. Sep 10 20:22:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [req-152b6e64-d540-4cae-80b6-50d4549bf52c req-3bf30cdb-6a9b-4482-936a-075531bfa80f tempest-TestShelveInstance-552922568 None] Lock "cinder-69241808-d133-4920-b3bc-171d6cfbda60-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:22:57 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:22:58 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Flow 'volume_create_manager' (3140a0aa-992c-4550-80fe-fc520ff7553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230419b5-aeec-4e10-94dc-926d0b52199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230419b5-aeec-4e10-94dc-926d0b52199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2069903560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d01f272-c576-409d-b5a6-ab4d8ee676f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76904792656b443d80807351fa235a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:23:17Z,use_quota=True,user_id='4e890532c1d54081bbe39ada199b1c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6145db-b313-4eb0-84ad-cba51f3310d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6145db-b313-4eb0-84ad-cba51f3310d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d8c851-b0c3-40ac-81f7-7e524deaf042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d8c851-b0c3-40ac-81f7-7e524deaf042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d01f272-c576-409d-b5a6-ab4d8ee676f6', 'volume_name': 'volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4103e9a0-7579-4b10-8207-bc49dd4d4136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4103e9a0-7579-4b10-8207-bc49dd4d4136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b237662-c28b-46d5-b4ee-94f14c854432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:23:17 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Volume 8d01f272-c576-409d-b5a6-ab4d8ee676f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6', 'volume_size': 1} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2069903560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d01f272-c576-409d-b5a6-ab4d8ee676f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76904792656b443d80807351fa235a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:23:17Z,use_quota=True,user_id='4e890532c1d54081bbe39ada199b1c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Creating volume 8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:23:17 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:23:17 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 1073741824 Sep 10 20:23:17 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:23:17 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 1073741824" returned: 0 in 0.421s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:23:17 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 Sep 10 20:23:17 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:23:17 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6" returned: 0 in 0.248s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:23:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:23:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b237662-c28b-46d5-b4ee-94f14c854432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:23:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83adb72-c3e5-4976-a2be-8679ca38bbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:23:18 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Volume volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 (8d01f272-c576-409d-b5a6-ab4d8ee676f6): created successfully Sep 10 20:23:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83adb72-c3e5-4976-a2be-8679ca38bbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:23:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Flow 'volume_create_manager' (3140a0aa-992c-4550-80fe-fc520ff7553c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:23:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-38108f2c-0ab1-491a-bd3c-a3ad19f4c657 tempest-TestStampPattern-637825388 None] Created volume successfully. Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:23:20 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:23:20 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:23:20 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.248s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:23:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:23:28 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:23:28 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:23:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-13545828-2cbb-4909-b1ce-a2fe053971a1 req-49b1f145-19d8-48dd-a173-a86f4ec9476d tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:23:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-13545828-2cbb-4909-b1ce-a2fe053971a1 req-49b1f145-19d8-48dd-a173-a86f4ec9476d tempest-TestStampPattern-637825388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:23:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-13545828-2cbb-4909-b1ce-a2fe053971a1 req-49b1f145-19d8-48dd-a173-a86f4ec9476d tempest-TestStampPattern-637825388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:23:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-13545828-2cbb-4909-b1ce-a2fe053971a1 req-49b1f145-19d8-48dd-a173-a86f4ec9476d tempest-TestStampPattern-637825388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b5a6b69-ecdb-4ad1-9adb-c5db13595975', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:23:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-13545828-2cbb-4909-b1ce-a2fe053971a1 req-49b1f145-19d8-48dd-a173-a86f4ec9476d tempest-TestStampPattern-637825388 None] attachment_update completed successfully. Sep 10 20:23:50 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-2df4c793-ac48-486a-9c49-9808ddbd2583 req-2f0fa3c7-b68f-43f3-885e-08aba687682a tempest-TestStampPattern-637825388 None] Terminate volume connection completed successfully. Sep 10 20:23:50 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-2df4c793-ac48-486a-9c49-9808ddbd2583 req-2f0fa3c7-b68f-43f3-885e-08aba687682a tempest-TestStampPattern-637825388 None] Deleting attachment 1b5a6b69-ecdb-4ad1-9adb-c5db13595975. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:23:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:23:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:23:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Creating offline snapshot 6e0007b8-1a98-46f6-a236-18ae7914d1ab of volume 8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:23:51 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[949094cc-e235-47b0-85a9-0ce98bb73628]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:23:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:23:51 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 Sep 10 20:23:51 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:23:51 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 10 20:23:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6" returned: 0 in 0.335s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:23:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:23:51 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab 1G Sep 10 20:23:51 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:23:52 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 10 20:23:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab 1G" returned: 0 in 0.366s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:23:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:23:52 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab Sep 10 20:23:52 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:23:52 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 10 20:23:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab" returned: 0 in 0.273s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:23:52 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab is being set with open permissions: ugo+rw Sep 10 20:23:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:23:52 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab Sep 10 20:23:52 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:23:52 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 10 20:23:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab" returned: 0 in 0.235s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:23:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:23:52 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.info Sep 10 20:23:52 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:23:53 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 10 20:23:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.info" returned: 0 in 0.238s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:23:53 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.info is being set with open permissions: ugo+rw Sep 10 20:23:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:23:53 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.info Sep 10 20:23:53 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:23:53 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 10 20:23:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.info" returned: 0 in 0.241s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:23:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.770s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:23:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4ba86413-f6ce-42de-a2ca-37db7be5fcbe tempest-TestStampPattern-637825388 None] Create snapshot completed successfully Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Flow 'volume_create_manager' (97023d77-553c-43e3-9546-277448bd5c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fca671b-db56-4e85-b3ae-ea2a4cf09277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fca671b-db56-4e85-b3ae-ea2a4cf09277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1233908002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4221fe10-3a19-4adb-8fdf-d632a267844f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76904792656b443d80807351fa235a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6e0007b8-1a98-46f6-a236-18ae7914d1ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:24:00Z,use_quota=True,user_id='4e890532c1d54081bbe39ada199b1c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124cf618-c843-4c8d-937c-596ef0814f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124cf618-c843-4c8d-937c-596ef0814f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2675168-50af-41dd-ae6e-20110d2100ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2675168-50af-41dd-ae6e-20110d2100ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4221fe10-3a19-4adb-8fdf-d632a267844f', 'volume_name': 'volume-4221fe10-3a19-4adb-8fdf-d632a267844f', 'volume_size': 1, 'snapshot_id': '6e0007b8-1a98-46f6-a236-18ae7914d1ab'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4605cc-a601-40e9-a76c-0e32b9a57ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4605cc-a601-40e9-a76c-0e32b9a57ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7591df-9dfd-41d4-a4d0-5ed00bc1eb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:24:00 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Volume 4221fe10-3a19-4adb-8fdf-d632a267844f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4221fe10-3a19-4adb-8fdf-d632a267844f', 'volume_size': 1, 'snapshot_id': '6e0007b8-1a98-46f6-a236-18ae7914d1ab'} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Acquiring lock "cinder-quobyte-6e0007b8-1a98-46f6-a236-18ae7914d1ab-4221fe10-3a19-4adb-8fdf-d632a267844f" by "_create_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-6e0007b8-1a98-46f6-a236-18ae7914d1ab-4221fe10-3a19-4adb-8fdf-d632a267844f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Creating volume 4221fe10-3a19-4adb-8fdf-d632a267844f from snapshot 6e0007b8-1a98-46f6-a236-18ae7914d1ab {{(pid=88137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Acquiring lock "cinder-quobyte-4221fe10-3a19-4adb-8fdf-d632a267844f" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-4221fe10-3a19-4adb-8fdf-d632a267844f" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] snapshot: 6e0007b8-1a98-46f6-a236-18ae7914d1ab, volume: 4221fe10-3a19-4adb-8fdf-d632a267844f, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c1deac-03fb-4e25-8ac6-bdf251483c1e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:00 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab Sep 10 20:24:00 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:00 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab" returned: 0 in 0.364s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f11716-f6c1-4962-ac1a-d5b5e8f9a303]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:24:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:00 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 Sep 10 20:24:00 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:01 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6" returned: 0 in 0.381s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:24:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:24:01 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:24:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:01 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f Sep 10 20:24:01 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:06 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f" returned: 0 in 5.764s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:06 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:24:06 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Converted 1024.00 MB image at 177.55 MB/s Sep 10 20:24:06 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f is being set with open permissions: ugo+rw Sep 10 20:24:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:06 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f Sep 10 20:24:06 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:07 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f" returned: 0 in 0.359s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-4221fe10-3a19-4adb-8fdf-d632a267844f" released by "_copy_volume_from_snapshot" :: held 6.962s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:24:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-6e0007b8-1a98-46f6-a236-18ae7914d1ab-4221fe10-3a19-4adb-8fdf-d632a267844f" released by "_create_volume_from_snapshot" :: held 7.034s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:24:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.048s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:24:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7591df-9dfd-41d4-a4d0-5ed00bc1eb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4221fe10-3a19-4adb-8fdf-d632a267844f', 'volume_size': 1, 'snapshot_id': '6e0007b8-1a98-46f6-a236-18ae7914d1ab'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:24:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b704aaf-c0d4-42db-8fd0-ba6934d73613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:24:07 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Volume volume-4221fe10-3a19-4adb-8fdf-d632a267844f (4221fe10-3a19-4adb-8fdf-d632a267844f): created successfully Sep 10 20:24:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b704aaf-c0d4-42db-8fd0-ba6934d73613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:24:07 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Flow 'volume_create_manager' (97023d77-553c-43e3-9546-277448bd5c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:24:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e524a5dd-76ec-4951-a1c1-6455998d3f05 tempest-TestStampPattern-637825388 None] Created volume successfully. Sep 10 20:24:17 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:24:17 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=20,cinder:UPDATE=3,cinder:DELETE=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:20 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:24:20 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:20 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.294s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:24:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:24:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-65db8f74-38f0-485f-887c-36bfc0ef0535 req-35f4eed1-8336-42c0-9d67-877f6777dd7f tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:24:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-65db8f74-38f0-485f-887c-36bfc0ef0535 req-35f4eed1-8336-42c0-9d67-877f6777dd7f tempest-TestStampPattern-637825388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:24:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [req-65db8f74-38f0-485f-887c-36bfc0ef0535 req-35f4eed1-8336-42c0-9d67-877f6777dd7f tempest-TestStampPattern-637825388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:24:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-65db8f74-38f0-485f-887c-36bfc0ef0535 req-35f4eed1-8336-42c0-9d67-877f6777dd7f tempest-TestStampPattern-637825388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8', 'name': 'volume-4221fe10-3a19-4adb-8fdf-d632a267844f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f75e24fa-188b-43ae-af26-8b43ffe27954', 'enforce_multipath': True} {{(pid=88137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 20:24:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-65db8f74-38f0-485f-887c-36bfc0ef0535 req-35f4eed1-8336-42c0-9d67-877f6777dd7f tempest-TestStampPattern-637825388 None] attachment_update completed successfully. Sep 10 20:24:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [req-11c072cd-8744-4803-8347-329b2ccab862 req-9d708c7a-04e4-4de0-898e-640c23ccdce2 tempest-TestStampPattern-637825388 None] Terminate volume connection completed successfully. Sep 10 20:24:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [req-11c072cd-8744-4803-8347-329b2ccab862 req-9d708c7a-04e4-4de0-898e-640c23ccdce2 tempest-TestStampPattern-637825388 None] Deleting attachment f75e24fa-188b-43ae-af26-8b43ffe27954. {{(pid=88137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Acquiring lock "cinder-4221fe10-3a19-4adb-8fdf-d632a267844f-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Lock "cinder-4221fe10-3a19-4adb-8fdf-d632a267844f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Acquiring lock "cinder-quobyte-4221fe10-3a19-4adb-8fdf-d632a267844f" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-4221fe10-3a19-4adb-8fdf-d632a267844f" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff94f85-38cd-4fad-94f2-784827de9111]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:56 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f Sep 10 20:24:56 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:56 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f" returned: 0 in 0.384s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:56 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f Sep 10 20:24:56 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:56 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-4221fe10-3a19-4adb-8fdf-d632a267844f" returned: 0 in 0.233s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-4221fe10-3a19-4adb-8fdf-d632a267844f" released by "delete_volume" :: held 0.654s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Created reservations ['7d77f4c4-ea0b-4c2d-8384-cc64314ca20d', 'aeede334-9f20-4611-989f-bd730769c790', '499e55eb-a4ff-494d-b045-50581f03fe01', '75827b1e-cba4-4cc5-8519-67d5b0ad706b'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:24:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:56 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:24:56 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:57 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.240s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:24:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Deleted volume successfully. Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-09f096b1-11e9-47ae-a275-e9e9960cd3b3 tempest-TestStampPattern-637825388 None] Lock "cinder-4221fe10-3a19-4adb-8fdf-d632a267844f-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Acquiring lock "cinder-6e0007b8-1a98-46f6-a236-18ae7914d1ab-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Lock "cinder-6e0007b8-1a98-46f6-a236-18ae7914d1ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Acquiring lock "cinder-quobyte-8d01f272-c576-409d-b5a6-ab4d8ee676f6" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-8d01f272-c576-409d-b5a6-ab4d8ee676f6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Acquiring lock "cinder-quobyte-6e0007b8-1a98-46f6-a236-18ae7914d1ab" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-6e0007b8-1a98-46f6-a236-18ae7914d1ab" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Deleting offline snapshot 6e0007b8-1a98-46f6-a236-18ae7914d1ab of volume 8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] snapshot_file for this snap is: volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f217d61a-5ff6-4053-8e0b-7a7707a8d92c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:57 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab Sep 10 20:24:57 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:57 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab" returned: 0 in 0.341s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc19390-7b91-46e7-ba85-c8f37e231e82]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:24:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:57 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 Sep 10 20:24:57 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:58 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6" returned: 0 in 0.516s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:58 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab Sep 10 20:24:58 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:58 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab" returned: 0 in 0.322s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:24:58 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab Sep 10 20:24:58 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:24:58 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 10 20:24:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6.6e0007b8-1a98-46f6-a236-18ae7914d1ab" returned: 0 in 0.265s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:24:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-6e0007b8-1a98-46f6-a236-18ae7914d1ab" released by "_delete_snapshot" :: held 1.548s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:24:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-8d01f272-c576-409d-b5a6-ab4d8ee676f6" released by "delete_snapshot" :: held 1.573s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:24:59 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Created reservations ['84bd2cf8-5427-4038-976b-3d0494da9c65', '7bbabaa6-6537-41fd-a65c-3b9af0859317', 'fafcc70f-a700-4ebe-8e4b-0ad72d07f326', '7d5b3a6e-7dde-41b8-84a3-a582dd0cb8df'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:24:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Delete snapshot completed successfully. Sep 10 20:24:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-721c9c09-3fb7-4296-8504-94c9b922d808 tempest-TestStampPattern-637825388 None] Lock "cinder-6e0007b8-1a98-46f6-a236-18ae7914d1ab-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Acquiring lock "cinder-8d01f272-c576-409d-b5a6-ab4d8ee676f6-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Lock "cinder-8d01f272-c576-409d-b5a6-ab4d8ee676f6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Acquiring lock "cinder-quobyte-8d01f272-c576-409d-b5a6-ab4d8ee676f6" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-8d01f272-c576-409d-b5a6-ab4d8ee676f6" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf616f-37fc-4a5a-8272-301d1507e60c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:03 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 Sep 10 20:25:03 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:03 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6" returned: 0 in 0.352s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:03 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6 Sep 10 20:25:03 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:03 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-8d01f272-c576-409d-b5a6-ab4d8ee676f6" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Lock "cinder-quobyte-8d01f272-c576-409d-b5a6-ab4d8ee676f6" released by "delete_volume" :: held 0.661s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Created reservations ['fec65585-4b74-4669-a62d-646a8940db4a', 'c9452f00-5d68-4aec-ac04-b05d5d0cc3bc', 'af8966b0-5eff-4962-80a5-a57a261ccf4b', 'a68bf8f7-7bfd-411b-9f4e-05dda7757c79'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:03 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:25:03 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:04 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.241s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:04 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:25:04 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Deleted volume successfully. Sep 10 20:25:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a73cc159-1ee3-464c-ba64-f129c4cced59 tempest-TestStampPattern-637825388 None] Lock "cinder-8d01f272-c576-409d-b5a6-ab4d8ee676f6-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:13 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:25:14 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Flow 'volume_create_manager' (02294c31-682f-435b-98e2-627355d86e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6027a01d-12fa-4c25-8ed8-9060ef11f1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6027a01d-12fa-4c25-8ed8-9060ef11f1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786402217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51077ee-7978-42b5-955a-cf96c7c00dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b56904d6e5141d28741884ee58751d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:16Z,use_quota=True,user_id='bab1b19fa9a84156afb26486f983f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8807ae-fdd3-4685-ae18-3bae04080078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8807ae-fdd3-4685-ae18-3bae04080078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c53325-15eb-4849-9ba4-417fa146e10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c53325-15eb-4849-9ba4-417fa146e10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51077ee-7978-42b5-955a-cf96c7c00dcf', 'volume_name': 'volume-c51077ee-7978-42b5-955a-cf96c7c00dcf', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4018bfdd-37bf-4ba9-8fd3-3563ac843994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4018bfdd-37bf-4ba9-8fd3-3563ac843994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a56c376-9728-4445-9174-d96567132a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:15 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Volume c51077ee-7978-42b5-955a-cf96c7c00dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51077ee-7978-42b5-955a-cf96c7c00dcf', 'volume_size': 1} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786402217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51077ee-7978-42b5-955a-cf96c7c00dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b56904d6e5141d28741884ee58751d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:16Z,use_quota=True,user_id='bab1b19fa9a84156afb26486f983f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Creating volume c51077ee-7978-42b5-955a-cf96c7c00dcf {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:25:15 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:25:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:15 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf 1073741824 Sep 10 20:25:15 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:16 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf 1073741824" returned: 0 in 0.456s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:16 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf Sep 10 20:25:16 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:16 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:25:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a56c376-9728-4445-9174-d96567132a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51077ee-7978-42b5-955a-cf96c7c00dcf', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5292a6c9-4cce-44a1-b1ac-3c0dc5d190cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:16 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Volume volume-c51077ee-7978-42b5-955a-cf96c7c00dcf (c51077ee-7978-42b5-955a-cf96c7c00dcf): created successfully Sep 10 20:25:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5292a6c9-4cce-44a1-b1ac-3c0dc5d190cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:16 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Flow 'volume_create_manager' (02294c31-682f-435b-98e2-627355d86e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:16 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-287c0a39-35e9-4007-a989-602182b3f276 tempest-ProjectReaderTests-2067076822 None] Created volume successfully. Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Acquiring lock "cinder-c51077ee-7978-42b5-955a-cf96c7c00dcf-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Lock "cinder-c51077ee-7978-42b5-955a-cf96c7c00dcf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Acquiring lock "cinder-quobyte-c51077ee-7978-42b5-955a-cf96c7c00dcf" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Lock "cinder-quobyte-c51077ee-7978-42b5-955a-cf96c7c00dcf" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966e197-2a92-427c-bf72-b62205abea0f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:17 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf Sep 10 20:25:17 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:17 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf" returned: 0 in 0.364s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:17 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf Sep 10 20:25:17 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:17 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c51077ee-7978-42b5-955a-cf96c7c00dcf" returned: 0 in 0.243s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Lock "cinder-quobyte-c51077ee-7978-42b5-955a-cf96c7c00dcf" released by "delete_volume" :: held 0.643s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Created reservations ['d61655bf-4335-4bea-950b-5df6a906395d', '34bcb2ac-baf0-41c4-9817-4a9d82cd59dd', '2f94c22b-c9f9-4274-beb5-6a1ca5b53ba6', '93224990-20f6-4236-a44f-5851da894370'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:17 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:25:17 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:18 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.241s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:25:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Deleted volume successfully. Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-43bdeafa-ebe2-498f-b79f-360f15422c93 tempest-ProjectReaderTests-2067076822 None] Lock "cinder-c51077ee-7978-42b5-955a-cf96c7c00dcf-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Flow 'volume_create_manager' (f530a95f-b2b3-46c5-a184-bf294bd253fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa9b5ba-9e78-41ed-93cf-b0401c5fb9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa9b5ba-9e78-41ed-93cf-b0401c5fb9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672763981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a0e9b-9caa-4291-ad44-62321f020648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b56904d6e5141d28741884ee58751d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:19Z,use_quota=True,user_id='bab1b19fa9a84156afb26486f983f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6bed62-8218-4280-83e2-7ae9313b0429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6bed62-8218-4280-83e2-7ae9313b0429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da6c2a4-70c9-4d5d-be90-5f48b9d31f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da6c2a4-70c9-4d5d-be90-5f48b9d31f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805a0e9b-9caa-4291-ad44-62321f020648', 'volume_name': 'volume-805a0e9b-9caa-4291-ad44-62321f020648', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029f68ae-9ee6-45ef-91fe-fcb2e610222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029f68ae-9ee6-45ef-91fe-fcb2e610222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7baab3-d0fa-487e-a0a0-0d8f290b04e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:18 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Volume 805a0e9b-9caa-4291-ad44-62321f020648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805a0e9b-9caa-4291-ad44-62321f020648', 'volume_size': 1} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672763981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a0e9b-9caa-4291-ad44-62321f020648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b56904d6e5141d28741884ee58751d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:19Z,use_quota=True,user_id='bab1b19fa9a84156afb26486f983f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Creating volume 805a0e9b-9caa-4291-ad44-62321f020648 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:25:18 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:25:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:18 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648 1073741824 Sep 10 20:25:18 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:19 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648 1073741824" returned: 0 in 0.424s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:19 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648 Sep 10 20:25:19 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:19 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648" returned: 0 in 0.246s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7baab3-d0fa-487e-a0a0-0d8f290b04e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805a0e9b-9caa-4291-ad44-62321f020648', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c0b3ce-727e-490a-8862-0baf890e20bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Volume volume-805a0e9b-9caa-4291-ad44-62321f020648 (805a0e9b-9caa-4291-ad44-62321f020648): created successfully Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c0b3ce-727e-490a-8862-0baf890e20bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Flow 'volume_create_manager' (f530a95f-b2b3-46c5-a184-bf294bd253fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-095f5d9c-5726-4de4-b464-925a2d5a5f6b tempest-ProjectReaderTests-2067076822 None] Created volume successfully. Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Acquiring lock "cinder-805a0e9b-9caa-4291-ad44-62321f020648-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Lock "cinder-805a0e9b-9caa-4291-ad44-62321f020648-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Acquiring lock "cinder-quobyte-805a0e9b-9caa-4291-ad44-62321f020648" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Lock "cinder-quobyte-805a0e9b-9caa-4291-ad44-62321f020648" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e742abbb-3c2b-46dc-a31c-9de8c5882750]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:25:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:19 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648 Sep 10 20:25:19 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:20 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648" returned: 0 in 0.339s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:20 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648 Sep 10 20:25:20 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:20 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-805a0e9b-9caa-4291-ad44-62321f020648" returned: 0 in 0.248s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Lock "cinder-quobyte-805a0e9b-9caa-4291-ad44-62321f020648" released by "delete_volume" :: held 0.627s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Created reservations ['6457e8e6-b19f-4c94-aaf8-dccb9e6129d4', '5bff86bd-c53a-40ac-8271-0ce6acdc5dd8', 'c9ec877f-4e95-46f7-9fc2-5bc43094ecde', '2808ec12-7fe0-4e42-bfb8-7e110e1e9fa2'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:20 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:25:20 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:20 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:25:20 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:20 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.244s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:25:20 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Deleted volume successfully. Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-364224c5-9413-4aa3-808f-96158287f671 tempest-ProjectReaderTests-2067076822 None] Lock "cinder-805a0e9b-9caa-4291-ad44-62321f020648-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:20 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.257s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:25:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Flow 'volume_create_manager' (f9cc10f8-3f7a-4c9e-b543-3a958718b222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275ad39a-c48c-418f-b386-b95377bf9345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275ad39a-c48c-418f-b386-b95377bf9345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241475250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc0c275-2390-48c0-8dc1-609fd53e817d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d04d9b14509491cb68b09540d49f34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:24Z,use_quota=True,user_id='3d6aa4a8f6b94398a0adb8b1c07b2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a96508-2c58-42f4-a5ac-750964c83abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a96508-2c58-42f4-a5ac-750964c83abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175b2072-aae1-4bb3-af63-bd80db7ceaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175b2072-aae1-4bb3-af63-bd80db7ceaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc0c275-2390-48c0-8dc1-609fd53e817d', 'volume_name': 'volume-2fc0c275-2390-48c0-8dc1-609fd53e817d', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3255b792-8d05-4e2b-9eb5-e85c6dff4af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3255b792-8d05-4e2b-9eb5-e85c6dff4af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb93668-a115-4310-b8ec-60960e21d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:24 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Volume 2fc0c275-2390-48c0-8dc1-609fd53e817d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc0c275-2390-48c0-8dc1-609fd53e817d', 'volume_size': 1} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241475250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc0c275-2390-48c0-8dc1-609fd53e817d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d04d9b14509491cb68b09540d49f34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:24Z,use_quota=True,user_id='3d6aa4a8f6b94398a0adb8b1c07b2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Creating volume 2fc0c275-2390-48c0-8dc1-609fd53e817d {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:25:24 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:24 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d 1073741824 Sep 10 20:25:24 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:24 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d 1073741824" returned: 0 in 0.395s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:24 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d Sep 10 20:25:24 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:24 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d" returned: 0 in 0.240s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb93668-a115-4310-b8ec-60960e21d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc0c275-2390-48c0-8dc1-609fd53e817d', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711b2409-b922-40e7-8b75-8099e4f48602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:24 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Volume volume-2fc0c275-2390-48c0-8dc1-609fd53e817d (2fc0c275-2390-48c0-8dc1-609fd53e817d): created successfully Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711b2409-b922-40e7-8b75-8099e4f48602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Flow 'volume_create_manager' (f9cc10f8-3f7a-4c9e-b543-3a958718b222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:24 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ff8bee77-7316-4265-a16f-98f7aeee1d50 tempest-ProjectReaderTests-1735972628 None] Created volume successfully. Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "cinder-2fc0c275-2390-48c0-8dc1-609fd53e817d-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Lock "cinder-2fc0c275-2390-48c0-8dc1-609fd53e817d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "cinder-quobyte-2fc0c275-2390-48c0-8dc1-609fd53e817d" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Lock "cinder-quobyte-2fc0c275-2390-48c0-8dc1-609fd53e817d" acquired by "delete_volume" :: waited 0.013s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed637c-b9a8-471b-8588-1291f6b97c19]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:25 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d Sep 10 20:25:25 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:25 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d" returned: 0 in 0.341s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:25 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d Sep 10 20:25:25 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:25 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2fc0c275-2390-48c0-8dc1-609fd53e817d" returned: 0 in 0.231s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Lock "cinder-quobyte-2fc0c275-2390-48c0-8dc1-609fd53e817d" released by "delete_volume" :: held 0.606s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Created reservations ['bc84c3b3-90c3-4671-a4d3-c2826dcda437', '0d429589-229c-411c-b785-4698455d19d5', '22a2a6fd-413e-49b6-beb0-26e5d79f7951', 'bbd60e86-1a2c-4e0c-a5e4-ba6dc36d1bb3'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:26 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:25:26 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:26 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.231s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:25:26 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Deleted volume successfully. Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf6703b7-5931-48e9-9493-8c52700304b8 tempest-ProjectReaderTests-1735972628 None] Lock "cinder-2fc0c275-2390-48c0-8dc1-609fd53e817d-delete_volume" released by "delete_volume" :: held 1.009s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Flow 'volume_create_manager' (cc90bf23-c540-4b51-85c3-9c7fec92e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f8fbba-2482-4c79-8ea4-9df12c9b4e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f8fbba-2482-4c79-8ea4-9df12c9b4e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066670214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34026d10-fd3f-464e-9b2b-1468f2d17b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d04d9b14509491cb68b09540d49f34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:27Z,use_quota=True,user_id='3d6aa4a8f6b94398a0adb8b1c07b2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd5478b-d2dc-41dc-a8b0-f5c9df500329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd5478b-d2dc-41dc-a8b0-f5c9df500329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eddb99e-06e0-4458-9335-709e8e8423ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eddb99e-06e0-4458-9335-709e8e8423ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34026d10-fd3f-464e-9b2b-1468f2d17b60', 'volume_name': 'volume-34026d10-fd3f-464e-9b2b-1468f2d17b60', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c84c9b-0c6b-4b9b-8b1c-b0c1e7b5901f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c84c9b-0c6b-4b9b-8b1c-b0c1e7b5901f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d794c873-5578-42aa-a132-b2bd5cff3318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:26 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Volume 34026d10-fd3f-464e-9b2b-1468f2d17b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34026d10-fd3f-464e-9b2b-1468f2d17b60', 'volume_size': 1} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066670214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34026d10-fd3f-464e-9b2b-1468f2d17b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d04d9b14509491cb68b09540d49f34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:27Z,use_quota=True,user_id='3d6aa4a8f6b94398a0adb8b1c07b2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Creating volume 34026d10-fd3f-464e-9b2b-1468f2d17b60 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:25:26 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:25:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:27 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 1073741824 Sep 10 20:25:27 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:27 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 1073741824" returned: 0 in 0.384s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:27 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 Sep 10 20:25:27 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:27 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60" returned: 0 in 0.233s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.657s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d794c873-5578-42aa-a132-b2bd5cff3318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34026d10-fd3f-464e-9b2b-1468f2d17b60', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163ecda0-93c2-451c-90bc-9443d48886da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Volume volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 (34026d10-fd3f-464e-9b2b-1468f2d17b60): created successfully Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163ecda0-93c2-451c-90bc-9443d48886da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Flow 'volume_create_manager' (cc90bf23-c540-4b51-85c3-9c7fec92e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-cb4d1e78-ac17-4215-a0df-ec2fc25f7281 tempest-ProjectReaderTests-1735972628 None] Created volume successfully. Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Acquiring lock "cinder-34026d10-fd3f-464e-9b2b-1468f2d17b60-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Lock "cinder-34026d10-fd3f-464e-9b2b-1468f2d17b60-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Acquiring lock "cinder-quobyte-34026d10-fd3f-464e-9b2b-1468f2d17b60" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Lock "cinder-quobyte-34026d10-fd3f-464e-9b2b-1468f2d17b60" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15ddc42-0936-4531-b078-e96b7329b14d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:28 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 Sep 10 20:25:28 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:28 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60" returned: 0 in 0.332s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:28 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60 Sep 10 20:25:28 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:28 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-34026d10-fd3f-464e-9b2b-1468f2d17b60" returned: 0 in 0.232s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Lock "cinder-quobyte-34026d10-fd3f-464e-9b2b-1468f2d17b60" released by "delete_volume" :: held 0.601s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Created reservations ['e762ae67-a6cc-4740-865f-711dee374539', '5e7b2a0a-4bd6-4405-b270-db335951e294', 'c9519d49-d6b2-49b7-a94f-596854855455', '4a90cea3-8982-4c03-aca4-2a137d36a7f2'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:28 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:25:28 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:28 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.233s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:25:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Deleted volume successfully. Sep 10 20:25:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-422ec4ab-8ace-4330-bb0c-4b80d8a50cdb tempest-ProjectReaderTests-1735972628 None] Lock "cinder-34026d10-fd3f-464e-9b2b-1468f2d17b60-delete_volume" released by "delete_volume" :: held 1.008s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Flow 'volume_create_manager' (172f371f-1944-4c0f-8f0e-ce775f0d2f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ddee38-a4f7-4fb1-9378-1ae7538a888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ddee38-a4f7-4fb1-9378-1ae7538a888e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198826350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118d43db-9977-4a64-96c4-b0cfbd65829e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d04d9b14509491cb68b09540d49f34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:29Z,use_quota=True,user_id='3d6aa4a8f6b94398a0adb8b1c07b2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288c8aae-a2ce-417c-ba08-930b01b5d13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288c8aae-a2ce-417c-ba08-930b01b5d13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad9c386-f177-4494-a688-b6a6b0bd440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad9c386-f177-4494-a688-b6a6b0bd440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '118d43db-9977-4a64-96c4-b0cfbd65829e', 'volume_name': 'volume-118d43db-9977-4a64-96c4-b0cfbd65829e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ff3043-c0a1-4fb6-a0ee-2b81ad2d48fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ff3043-c0a1-4fb6-a0ee-2b81ad2d48fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f7acc9-8f5f-4790-b1cf-0f7d960bb36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:29 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Volume 118d43db-9977-4a64-96c4-b0cfbd65829e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-118d43db-9977-4a64-96c4-b0cfbd65829e', 'volume_size': 1} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198826350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118d43db-9977-4a64-96c4-b0cfbd65829e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d04d9b14509491cb68b09540d49f34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:29Z,use_quota=True,user_id='3d6aa4a8f6b94398a0adb8b1c07b2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Creating volume 118d43db-9977-4a64-96c4-b0cfbd65829e {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:25:29 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:25:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:29 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e 1073741824 Sep 10 20:25:29 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:30 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e 1073741824" returned: 0 in 0.399s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:30 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e Sep 10 20:25:30 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:30 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e" returned: 0 in 0.237s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f7acc9-8f5f-4790-b1cf-0f7d960bb36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118d43db-9977-4a64-96c4-b0cfbd65829e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eb8b89-2d17-4d83-913c-ecf14140f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Volume volume-118d43db-9977-4a64-96c4-b0cfbd65829e (118d43db-9977-4a64-96c4-b0cfbd65829e): created successfully Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eb8b89-2d17-4d83-913c-ecf14140f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Flow 'volume_create_manager' (172f371f-1944-4c0f-8f0e-ce775f0d2f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3a79f183-b854-4d8c-b34f-6023679711af tempest-ProjectReaderTests-1735972628 None] Created volume successfully. Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "cinder-118d43db-9977-4a64-96c4-b0cfbd65829e-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Lock "cinder-118d43db-9977-4a64-96c4-b0cfbd65829e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "cinder-quobyte-118d43db-9977-4a64-96c4-b0cfbd65829e" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Lock "cinder-quobyte-118d43db-9977-4a64-96c4-b0cfbd65829e" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[212f073c-63b4-4a10-b42b-689512c46484]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:25:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:30 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e Sep 10 20:25:30 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:31 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e" returned: 0 in 0.349s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:31 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e Sep 10 20:25:31 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:31 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-118d43db-9977-4a64-96c4-b0cfbd65829e" returned: 0 in 0.238s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Lock "cinder-quobyte-118d43db-9977-4a64-96c4-b0cfbd65829e" released by "delete_volume" :: held 0.621s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Created reservations ['8115783c-10db-4ab2-9512-105378d104f6', '4b92ce63-946e-4fde-ae01-a146d44deb0a', '1f6b12cd-65db-4bf1-83cd-793ca24a07ca', 'df330785-5016-4316-a151-a75d8c5d88fd'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:31 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:25:31 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:31 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.233s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:25:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Deleted volume successfully. Sep 10 20:25:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6f755610-da97-4871-8852-79a3d36ead18 tempest-ProjectReaderTests-1735972628 None] Lock "cinder-118d43db-9977-4a64-96c4-b0cfbd65829e-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Flow 'volume_create_manager' (76be10a9-c270-4372-8272-75de5d070b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1ebe1c-4a40-432e-8081-6d47987f11fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1ebe1c-4a40-432e-8081-6d47987f11fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022727467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f4cde5-e94f-48db-90b2-37d3a4c381a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d04d9b14509491cb68b09540d49f34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:32Z,use_quota=True,user_id='3d6aa4a8f6b94398a0adb8b1c07b2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bb1af4-b480-4c08-b630-de38b6bf77bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bb1af4-b480-4c08-b630-de38b6bf77bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdef6c2-c54d-497a-8dc3-a56e69e574c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdef6c2-c54d-497a-8dc3-a56e69e574c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f4cde5-e94f-48db-90b2-37d3a4c381a8', 'volume_name': 'volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59231ccb-21f6-4bee-8f22-e1c5d54ae3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59231ccb-21f6-4bee-8f22-e1c5d54ae3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf376a29-5cc7-4c13-8f3c-acebdc4d2ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Volume 05f4cde5-e94f-48db-90b2-37d3a4c381a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8', 'volume_size': 1} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022727467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f4cde5-e94f-48db-90b2-37d3a4c381a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d04d9b14509491cb68b09540d49f34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:32Z,use_quota=True,user_id='3d6aa4a8f6b94398a0adb8b1c07b2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Creating volume 05f4cde5-e94f-48db-90b2-37d3a4c381a8 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:25:32 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:32 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 1073741824 Sep 10 20:25:32 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:32 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 1073741824" returned: 0 in 0.392s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:32 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 Sep 10 20:25:32 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:32 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8" returned: 0 in 0.229s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf376a29-5cc7-4c13-8f3c-acebdc4d2ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cbec73-8538-43e1-bdbc-1aec1c30c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Volume volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 (05f4cde5-e94f-48db-90b2-37d3a4c381a8): created successfully Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cbec73-8538-43e1-bdbc-1aec1c30c421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Flow 'volume_create_manager' (76be10a9-c270-4372-8272-75de5d070b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:32 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3da9acc4-83b6-4dc8-82f5-5dcf6a98342a tempest-ProjectReaderTests-1735972628 None] Created volume successfully. Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Acquiring lock "cinder-05f4cde5-e94f-48db-90b2-37d3a4c381a8-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Lock "cinder-05f4cde5-e94f-48db-90b2-37d3a4c381a8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Acquiring lock "cinder-quobyte-05f4cde5-e94f-48db-90b2-37d3a4c381a8" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Lock "cinder-quobyte-05f4cde5-e94f-48db-90b2-37d3a4c381a8" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[113c4c05-ac49-445a-8fd6-9f20eaf4edbe]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:33 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 Sep 10 20:25:33 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:33 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8" returned: 0 in 0.355s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:33 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8 Sep 10 20:25:33 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:33 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-05f4cde5-e94f-48db-90b2-37d3a4c381a8" returned: 0 in 0.229s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Lock "cinder-quobyte-05f4cde5-e94f-48db-90b2-37d3a4c381a8" released by "delete_volume" :: held 0.625s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Created reservations ['7cf96e24-03e9-4eed-a5d3-ce6b7a1367e6', '070a6e94-4af4-48fe-9d6a-eb36ffb841dc', '850d822c-684d-4784-9e12-c929b1eeadb2', '8de7f97e-0589-4242-8561-f246e11b09ab'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:33 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:25:33 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:34 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.234s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:34 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:25:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Deleted volume successfully. Sep 10 20:25:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-bf352dd4-f3e2-4097-b527-9c45dacc327f tempest-ProjectReaderTests-1735972628 None] Lock "cinder-05f4cde5-e94f-48db-90b2-37d3a4c381a8-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:25:43 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=41,cinder:UPDATE=66,cinder:INSERT=13,cinder:DELETE=5 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:25:44 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=43,cinder:UPDATE=66,cinder:DELETE=7,cinder:INSERT=17 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Flow 'volume_create_manager' (b57428af-80aa-4d07-9262-1608c90a645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52e0cc1-57dc-4195-9767-48aeb1b8c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52e0cc1-57dc-4195-9767-48aeb1b8c286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1303190119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c38001-aad4-479e-a903-b735a42e7498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9680e8c831e349599546fcadcbe5fc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:56Z,use_quota=True,user_id='f680d5dcb0ba44b7b475515266b1606c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9ae6b8-0e42-4783-9c2e-44b18189a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9ae6b8-0e42-4783-9c2e-44b18189a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4090796c-13e6-463d-8739-c782f88f87f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4090796c-13e6-463d-8739-c782f88f87f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c38001-aad4-479e-a903-b735a42e7498', 'volume_name': 'volume-45c38001-aad4-479e-a903-b735a42e7498', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ad529d-9e2c-4945-b54f-4538988895ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ad529d-9e2c-4945-b54f-4538988895ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59660e63-f1ef-48e3-901e-49cbbd6a5ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:56 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Volume 45c38001-aad4-479e-a903-b735a42e7498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c38001-aad4-479e-a903-b735a42e7498', 'volume_size': 1} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1303190119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c38001-aad4-479e-a903-b735a42e7498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9680e8c831e349599546fcadcbe5fc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:25:56Z,use_quota=True,user_id='f680d5dcb0ba44b7b475515266b1606c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Creating volume 45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:25:56 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:56 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 1073741824 Sep 10 20:25:56 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:56 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 1073741824" returned: 0 in 0.399s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:56 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 Sep 10 20:25:56 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:57 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498" returned: 0 in 0.245s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59660e63-f1ef-48e3-901e-49cbbd6a5ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c38001-aad4-479e-a903-b735a42e7498', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c0ec26-949f-4518-878f-547e54ca36c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:25:57 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Volume volume-45c38001-aad4-479e-a903-b735a42e7498 (45c38001-aad4-479e-a903-b735a42e7498): created successfully Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c0ec26-949f-4518-878f-547e54ca36c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Flow 'volume_create_manager' (b57428af-80aa-4d07-9262-1608c90a645b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:25:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b1c5f707-d7b4-4ba9-b639-f784534f3826 tempest-SnapshotDependencyTests-1832909293 None] Created volume successfully. Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Creating offline snapshot 0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 of volume 45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e7755-f82d-4650-862f-789c276348d2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:25:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:57 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 Sep 10 20:25:57 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:58 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498" returned: 0 in 0.358s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:58 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 1G Sep 10 20:25:58 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:58 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 1G" returned: 0 in 0.398s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c38001-aad4-479e-a903-b735a42e7498 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:58 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c38001-aad4-479e-a903-b735a42e7498 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 Sep 10 20:25:58 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:58 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45c38001-aad4-479e-a903-b735a42e7498 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8" returned: 0 in 0.290s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:58 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 is being set with open permissions: ugo+rw Sep 10 20:25:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:58 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 Sep 10 20:25:58 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:58 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8" returned: 0 in 0.238s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:59 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.info Sep 10 20:25:59 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:59 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.info" returned: 0 in 0.246s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:59 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.info is being set with open permissions: ugo+rw Sep 10 20:25:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:25:59 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.info Sep 10 20:25:59 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:25:59 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 10 20:25:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.info" returned: 0 in 0.246s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:25:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:25:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-aae44b1b-9e72-47c0-bf86-9775a596fefb tempest-SnapshotDependencyTests-1832909293 None] Create snapshot completed successfully Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Flow 'volume_create_manager' (6008af9a-ef45-4da8-b43f-53a4d77db0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ee590d-5c49-47ef-ad5a-71442e53940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ee590d-5c49-47ef-ad5a-71442e53940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d24158-d3af-4dd1-90ba-b0b09d39f2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9680e8c831e349599546fcadcbe5fc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e873d7c-1d38-4f69-8a25-0b2fffbb58b8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:00Z,use_quota=True,user_id='f680d5dcb0ba44b7b475515266b1606c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271729d2-2b76-4fb9-8ea9-f8eeb6b8ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271729d2-2b76-4fb9-8ea9-f8eeb6b8ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b028e9cd-7f6d-4800-b175-6a6bbe87df7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b028e9cd-7f6d-4800-b175-6a6bbe87df7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23d24158-d3af-4dd1-90ba-b0b09d39f2e8', 'volume_name': 'volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8', 'volume_size': 1, 'snapshot_id': '0e873d7c-1d38-4f69-8a25-0b2fffbb58b8'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925937a5-8675-4661-8da0-ce7a96714716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925937a5-8675-4661-8da0-ce7a96714716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163707f8-9a29-442f-a82b-d2ea075fd7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:00 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Volume 23d24158-d3af-4dd1-90ba-b0b09d39f2e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8', 'volume_size': 1, 'snapshot_id': '0e873d7c-1d38-4f69-8a25-0b2fffbb58b8'} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "cinder-quobyte-0e873d7c-1d38-4f69-8a25-0b2fffbb58b8-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" by "_create_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-0e873d7c-1d38-4f69-8a25-0b2fffbb58b8-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Creating volume 23d24158-d3af-4dd1-90ba-b0b09d39f2e8 from snapshot 0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 {{(pid=88137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "cinder-quobyte-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] snapshot: 0e873d7c-1d38-4f69-8a25-0b2fffbb58b8, volume: 23d24158-d3af-4dd1-90ba-b0b09d39f2e8, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6da0d6-4a40-4faa-9135-43d52a6bdb24]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:00 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 Sep 10 20:26:00 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:00 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8" returned: 0 in 0.360s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45c38001-aad4-479e-a903-b735a42e7498(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1225b10d-e5a1-4bce-9467-43923d984fd8]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:00 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 Sep 10 20:26:00 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:01 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498" returned: 0 in 0.338s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:26:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:26:01 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:26:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:01 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 Sep 10 20:26:01 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:05 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" returned: 0 in 4.029s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:26:05 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Converted 1024.00 MB image at 254.06 MB/s Sep 10 20:26:05 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 is being set with open permissions: ugo+rw Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:05 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 Sep 10 20:26:05 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:05 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" returned: 0 in 0.237s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" released by "_copy_volume_from_snapshot" :: held 5.036s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-0e873d7c-1d38-4f69-8a25-0b2fffbb58b8-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" released by "_create_volume_from_snapshot" :: held 5.101s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.120s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163707f8-9a29-442f-a82b-d2ea075fd7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8', 'volume_size': 1, 'snapshot_id': '0e873d7c-1d38-4f69-8a25-0b2fffbb58b8'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4898e84d-66ff-43b9-864a-e983b638da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:05 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Volume volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 (23d24158-d3af-4dd1-90ba-b0b09d39f2e8): created successfully Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4898e84d-66ff-43b9-864a-e983b638da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Flow 'volume_create_manager' (6008af9a-ef45-4da8-b43f-53a4d77db0c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:05 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e3084982-0bc0-4061-9783-d004dd16da3b tempest-SnapshotDependencyTests-1832909293 None] Created volume successfully. Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "cinder-0e873d7c-1d38-4f69-8a25-0b2fffbb58b8-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-0e873d7c-1d38-4f69-8a25-0b2fffbb58b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "cinder-quobyte-45c38001-aad4-479e-a903-b735a42e7498" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-45c38001-aad4-479e-a903-b735a42e7498" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "cinder-quobyte-0e873d7c-1d38-4f69-8a25-0b2fffbb58b8" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-0e873d7c-1d38-4f69-8a25-0b2fffbb58b8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Deleting offline snapshot 0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 of volume 45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] snapshot_file for this snap is: volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c555b4-a613-4a21-8fd2-7a214989e021]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:05 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 Sep 10 20:26:05 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:06 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8" returned: 0 in 0.363s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:06 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45c38001-aad4-479e-a903-b735a42e7498(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:26:06 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[414048a8-7d94-43f1-830a-a1cdc12dfd11]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:06 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 Sep 10 20:26:06 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:06 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498" returned: 0 in 0.524s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:06 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 Sep 10 20:26:06 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:07 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8" returned: 0 in 0.321s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:07 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8 Sep 10 20:26:07 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:07 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498.0e873d7c-1d38-4f69-8a25-0b2fffbb58b8" returned: 0 in 0.235s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-0e873d7c-1d38-4f69-8a25-0b2fffbb58b8" released by "_delete_snapshot" :: held 1.527s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-45c38001-aad4-479e-a903-b735a42e7498" released by "delete_snapshot" :: held 1.549s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Created reservations ['7311d24b-f0a0-4dfc-9f3e-ec0a6f250f33', 'a087d611-5ae6-4adb-b61d-b143c5f6ef09', '0ccf826a-d2b0-45ea-a6ee-0f322b4e65a7', '9ecb3a7b-2a06-4215-824e-73cfe8e95628'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Delete snapshot completed successfully. Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-b8b91b13-995f-40b4-8a71-7525ff7e8dd2 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-0e873d7c-1d38-4f69-8a25-0b2fffbb58b8-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "cinder-45c38001-aad4-479e-a903-b735a42e7498-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-45c38001-aad4-479e-a903-b735a42e7498-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "cinder-quobyte-45c38001-aad4-479e-a903-b735a42e7498" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-45c38001-aad4-479e-a903-b735a42e7498" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[224124df-d8b3-4855-a707-21c3444e6830]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:08 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 Sep 10 20:26:08 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:08 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498" returned: 0 in 0.344s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:08 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498 Sep 10 20:26:08 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:08 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-45c38001-aad4-479e-a903-b735a42e7498" returned: 0 in 0.234s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-45c38001-aad4-479e-a903-b735a42e7498" released by "delete_volume" :: held 0.630s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Created reservations ['7992c95c-6a46-4040-ad0b-df356a6e18db', 'c7093c8e-44b5-4f8e-b58f-7f3f6eae388a', 'e263131f-4915-4edc-b2b8-a7b871445793', '27724df9-bfa9-4f3c-a8e8-0aff0f319835'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:08 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:08 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:08 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.240s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:08 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Deleted volume successfully. Sep 10 20:26:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec1a6e5e-b934-4e32-9cb9-5f98fc11173d tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-45c38001-aad4-479e-a903-b735a42e7498-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "cinder-23d24158-d3af-4dd1-90ba-b0b09d39f2e8-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-23d24158-d3af-4dd1-90ba-b0b09d39f2e8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "cinder-quobyte-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1435f48-0c9d-4a2a-b51d-8bd6dda9fc48]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:09 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 Sep 10 20:26:09 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:09 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" returned: 0 in 0.356s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:09 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8 Sep 10 20:26:09 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:09 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" returned: 0 in 0.240s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-quobyte-23d24158-d3af-4dd1-90ba-b0b09d39f2e8" released by "delete_volume" :: held 0.631s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Created reservations ['f085cc72-4ebb-472d-910c-2dc6ea855025', '07441f3e-5836-4d9e-ac96-404c9fa44f7b', '22570dee-e3be-4ff6-8d72-e683a26a3118', 'a3117d81-2eaf-4809-8293-343d7f1289dc'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:09 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:09 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:10 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.239s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:10 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:10 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Deleted volume successfully. Sep 10 20:26:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90a68b04-91fd-41de-bf38-293a945870c9 tempest-SnapshotDependencyTests-1832909293 None] Lock "cinder-23d24158-d3af-4dd1-90ba-b0b09d39f2e8-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:19 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=31,cinder:SELECT=21,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=29,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:20 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:20 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:20 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.264s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:26:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Flow 'volume_create_manager' (c2e884be-1018-483d-ad45-51b634bfb6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7200b824-f68b-4d4b-ac9d-07de0dd0b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7200b824-f68b-4d4b-ac9d-07de0dd0b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-771821616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97c2a29-7f53-4c62-8856-fa61c98f30f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9a5ddfb68b492ba1717fba6c970165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:30Z,use_quota=True,user_id='6db844aa45ec4ec19d863878b77adbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88070664-54c5-48aa-b469-d2fc3c1f3b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88070664-54c5-48aa-b469-d2fc3c1f3b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4958d992-1022-4bc7-be0f-f13800cfbed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4958d992-1022-4bc7-be0f-f13800cfbed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97c2a29-7f53-4c62-8856-fa61c98f30f3', 'volume_name': 'volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2ed6d4-126b-4ae0-9491-da98bb192007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2ed6d4-126b-4ae0-9491-da98bb192007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4ca32c-7ad9-4f83-914e-a031f2d71a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:29 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Volume b97c2a29-7f53-4c62-8856-fa61c98f30f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3', 'volume_size': 1} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-771821616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97c2a29-7f53-4c62-8856-fa61c98f30f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9a5ddfb68b492ba1717fba6c970165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:30Z,use_quota=True,user_id='6db844aa45ec4ec19d863878b77adbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Creating volume b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:29 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:29 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 1073741824 Sep 10 20:26:29 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (dfee0bcc-4692-42f3-a93a-8d65f5cad783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075062c9-5581-45e6-8548-e51292ccbd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075062c9-5581-45e6-8548-e51292ccbd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2000287337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7719324-692c-40e8-922d-dae15d1adf49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:30Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938daff1-d936-4c50-90d6-42f9b4c91ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938daff1-d936-4c50-90d6-42f9b4c91ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8494118-ba24-44b3-b80c-8885bdb26453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8494118-ba24-44b3-b80c-8885bdb26453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7719324-692c-40e8-922d-dae15d1adf49', 'volume_name': 'volume-c7719324-692c-40e8-922d-dae15d1adf49', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c3c86b-1d1e-4f21-b6fd-a2d7e74fe6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c3c86b-1d1e-4f21-b6fd-a2d7e74fe6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21e620f-c893-4bd0-90ed-aa582190e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Volume c7719324-692c-40e8-922d-dae15d1adf49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7719324-692c-40e8-922d-dae15d1adf49', 'volume_size': 1} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:30 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 1073741824" returned: 0 in 0.780s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:30 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 Sep 10 20:26:30 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (39d83a9e-a7d5-42f8-b294-9a785dc9987e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411925dc-7b4c-430d-9bc4-e662d1977fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411925dc-7b4c-430d-9bc4-e662d1977fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276099718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98155469-a182-42bd-bc76-be8953f8b337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:31Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601ac4c0-1bca-450a-be95-0353aecdeaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601ac4c0-1bca-450a-be95-0353aecdeaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65012aa-e7db-4fe6-baa8-691a41333005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65012aa-e7db-4fe6-baa8-691a41333005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98155469-a182-42bd-bc76-be8953f8b337', 'volume_name': 'volume-98155469-a182-42bd-bc76-be8953f8b337', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5885de4-e857-4b24-8b8e-fe60640f3dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5885de4-e857-4b24-8b8e-fe60640f3dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e459993-78ce-4dcf-855b-de5cc4bd323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume 98155469-a182-42bd-bc76-be8953f8b337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98155469-a182-42bd-bc76-be8953f8b337', 'volume_size': 1} Sep 10 20:26:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:30 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3" returned: 0 in 0.364s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.730s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2000287337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7719324-692c-40e8-922d-dae15d1adf49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:30Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Creating volume c7719324-692c-40e8-922d-dae15d1adf49 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:31 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4ca32c-7ad9-4f83-914e-a031f2d71a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49 1073741824 Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da378384-e717-45e5-88c3-f8dcfc235ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Volume volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 (b97c2a29-7f53-4c62-8856-fa61c98f30f3): created successfully Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da378384-e717-45e5-88c3-f8dcfc235ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Flow 'volume_create_manager' (c2e884be-1018-483d-ad45-51b634bfb6f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fa8a80b7-eb8e-40bb-93b9-78e0d7c132bb tempest-VolumeDependencyTests-1565007565 None] Created volume successfully. Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (31bbf963-3d0c-44a4-b2e4-2be3bf2c9790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b958ad-b820-4584-87ae-dfdc0db1445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b958ad-b820-4584-87ae-dfdc0db1445d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1303429355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b09cbf-8a88-49a0-94d9-420373c9b76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:31Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dde0cc-d6e8-4b26-9105-ab6523fdf71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dde0cc-d6e8-4b26-9105-ab6523fdf71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716c04cf-11df-4a2f-98e3-bf0e8aa5ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716c04cf-11df-4a2f-98e3-bf0e8aa5ab17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b09cbf-8a88-49a0-94d9-420373c9b76f', 'volume_name': 'volume-71b09cbf-8a88-49a0-94d9-420373c9b76f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0c8ed0-22d1-4bc5-997c-de5a76b1462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0c8ed0-22d1-4bc5-997c-de5a76b1462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab01410b-85f6-4ce8-86db-80424307e0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Volume 71b09cbf-8a88-49a0-94d9-420373c9b76f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b09cbf-8a88-49a0-94d9-420373c9b76f', 'volume_size': 1} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (d1bde60e-1fa3-49de-8284-17040d6722d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e98d60-25c6-4be1-a0d6-762d62bc29f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e98d60-25c6-4be1-a0d6-762d62bc29f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-6194749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d73f800-d35f-4a47-8a1f-6edd952d2d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:31Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11ef9d7-b636-4ebd-95d3-fc2eba7098b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11ef9d7-b636-4ebd-95d3-fc2eba7098b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9b1d78-4dd1-4889-be58-e9e065411c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9b1d78-4dd1-4889-be58-e9e065411c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d73f800-d35f-4a47-8a1f-6edd952d2d30', 'volume_name': 'volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3e4b0f-1bd6-4881-a940-2ebdbd376ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3e4b0f-1bd6-4881-a940-2ebdbd376ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77707a29-c1e5-47b4-a3bd-b16658c5d775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Volume 6d73f800-d35f-4a47-8a1f-6edd952d2d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30', 'volume_size': 1} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (2bb587a4-eebc-4226-aae7-03751f827dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e471a207-451c-4e7c-9709-af3473c4d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e471a207-451c-4e7c-9709-af3473c4d547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1103392440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b4d295-3bcb-4e55-9e4a-a914bf58a0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:32Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744a09b-ea90-4db9-a3bd-f7e3ca026248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744a09b-ea90-4db9-a3bd-f7e3ca026248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cf6aed-4c66-44c3-ad27-4d34d0edf072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cf6aed-4c66-44c3-ad27-4d34d0edf072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b4d295-3bcb-4e55-9e4a-a914bf58a0a0', 'volume_name': 'volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ef0ba5-7f38-4a2f-9418-e9995106712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ef0ba5-7f38-4a2f-9418-e9995106712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a714c1-0b9a-4261-bd96-82d6c663b084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:31 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Volume 74b4d295-3bcb-4e55-9e4a-a914bf58a0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0', 'volume_size': 1} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49 1073741824" returned: 0 in 0.706s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:31 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49 Sep 10 20:26:31 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (4c06d8d2-518c-457b-84d1-84ffcec61c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e257195f-cadb-42a8-be27-7e123ef9cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e257195f-cadb-42a8-be27-7e123ef9cb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1674831947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41985e80-5cfa-4f3d-bf1a-38e7b09a08d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:32Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5f7b37-b06e-4216-9343-24d398da94dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:32 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5f7b37-b06e-4216-9343-24d398da94dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654d0a79-2856-4249-8186-f4b76de05589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654d0a79-2856-4249-8186-f4b76de05589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41985e80-5cfa-4f3d-bf1a-38e7b09a08d9', 'volume_name': 'volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60f3133-ddc3-4572-a88c-1c0edfce5058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60f3133-ddc3-4572-a88c-1c0edfce5058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a530519-5591-4d80-bdb3-9c4e3bcae738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Volume 41985e80-5cfa-4f3d-bf1a-38e7b09a08d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9', 'volume_size': 1} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49" returned: 0 in 0.335s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276099718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98155469-a182-42bd-bc76-be8953f8b337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:31Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Creating volume 98155469-a182-42bd-bc76-be8953f8b337 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:32 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21e620f-c893-4bd0-90ed-aa582190e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7719324-692c-40e8-922d-dae15d1adf49', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e307a7-492c-4100-ad79-00547de1f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:32 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337 1073741824 Sep 10 20:26:32 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Volume volume-c7719324-692c-40e8-922d-dae15d1adf49 (c7719324-692c-40e8-922d-dae15d1adf49): created successfully Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e307a7-492c-4100-ad79-00547de1f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (dfee0bcc-4692-42f3-a93a-8d65f5cad783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:32 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-741acc5f-fdeb-40e8-a2c7-b2d5af020fff tempest-CreateVolumesFromImageTest-1419283597 None] Created volume successfully. Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:32 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337 1073741824" returned: 0 in 0.502s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:32 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337 Sep 10 20:26:32 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:32 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337" returned: 0 in 0.267s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1303429355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b09cbf-8a88-49a0-94d9-420373c9b76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:31Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Creating volume 71b09cbf-8a88-49a0-94d9-420373c9b76f {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:32 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e459993-78ce-4dcf-855b-de5cc4bd323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98155469-a182-42bd-bc76-be8953f8b337', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:32 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f 1073741824 Sep 10 20:26:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38063fa-e56d-4b2c-9d31-ed1a10b5d2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:32 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume volume-98155469-a182-42bd-bc76-be8953f8b337 (98155469-a182-42bd-bc76-be8953f8b337): created successfully Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38063fa-e56d-4b2c-9d31-ed1a10b5d2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (39d83a9e-a7d5-42f8-b294-9a785dc9987e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f0a7f8da-84de-43ac-a593-a5219c9d25a0 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created volume successfully. Sep 10 20:26:33 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f 1073741824" returned: 0 in 0.522s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:33 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f Sep 10 20:26:33 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:33 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f" returned: 0 in 0.303s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.314s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-6194749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d73f800-d35f-4a47-8a1f-6edd952d2d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:31Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Creating volume 6d73f800-d35f-4a47-8a1f-6edd952d2d30 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:33 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab01410b-85f6-4ce8-86db-80424307e0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b09cbf-8a88-49a0-94d9-420373c9b76f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd5b4e5-fc04-4784-9777-2a4d46ce30be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Volume volume-71b09cbf-8a88-49a0-94d9-420373c9b76f (71b09cbf-8a88-49a0-94d9-420373c9b76f): created successfully Sep 10 20:26:33 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 1073741824 Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd5b4e5-fc04-4784-9777-2a4d46ce30be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:33 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (31bbf963-3d0c-44a4-b2e4-2be3bf2c9790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a410c405-c651-4c74-aced-41f084790c69 tempest-CreateVolumesFromImageTest-1419283597 None] Created volume successfully. Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (1d3a6dd5-a9c2-4bad-9835-5aa13206d57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8063804e-9c2d-44f1-b607-78beeefa12fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8063804e-9c2d-44f1-b607-78beeefa12fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-254428786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c23b39-edf9-4073-9209-cb560c190bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:34Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699f4b01-2823-4645-b085-10b50504783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699f4b01-2823-4645-b085-10b50504783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366fb43c-4f8b-49fe-b8f9-19d6ce52cbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366fb43c-4f8b-49fe-b8f9-19d6ce52cbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c23b39-edf9-4073-9209-cb560c190bb7', 'volume_name': 'volume-b2c23b39-edf9-4073-9209-cb560c190bb7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604d25e7-17d4-4a0b-a087-3c9ce05f0dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604d25e7-17d4-4a0b-a087-3c9ce05f0dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a805cf8-dcff-4399-a097-d08a895c718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume b2c23b39-edf9-4073-9209-cb560c190bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c23b39-edf9-4073-9209-cb560c190bb7', 'volume_size': 1} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:34 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 1073741824" returned: 0 in 0.686s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Flow 'volume_create_manager' (20032d77-2dea-4441-9a32-2da49a4f6263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe80fc6-efcb-4213-a793-821fbc47333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:34 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 Sep 10 20:26:34 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe80fc6-efcb-4213-a793-821fbc47333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ffb061-681b-4cd0-8722-21a2274948da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3089c0ad4c17442b88fdbb789537134d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:34Z,use_quota=True,user_id='038479cc71d4435e9192a3b9d14068d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a14ce68-607e-4811-886c-c08074084c3b),volume_type_id=3a14ce68-607e-4811-886c-c08074084c3b)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150409c7-6a2a-448e-91df-ed02d6d1260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150409c7-6a2a-448e-91df-ed02d6d1260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edf00f8-4d8c-49a4-bc14-af4c5c90b96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (2f39d2ad-c397-4a36-b7af-943e470415e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab15aac-69f1-42b9-ab6b-0299a97ddd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab15aac-69f1-42b9-ab6b-0299a97ddd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110174767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9802c10d-feae-4f8c-845a-563abc554b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:35Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983de378-deb2-4d56-aef8-a3a27e6d976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983de378-deb2-4d56-aef8-a3a27e6d976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a2ddf2-1dd8-49da-8597-169e04089df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a2ddf2-1dd8-49da-8597-169e04089df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9802c10d-feae-4f8c-845a-563abc554b9b', 'volume_name': 'volume-9802c10d-feae-4f8c-845a-563abc554b9b', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ae3d6f-4aa0-43de-bd74-d770871b6486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ae3d6f-4aa0-43de-bd74-d770871b6486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ec84a5-ba74-4dbf-8458-6e1df4050cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume 9802c10d-feae-4f8c-845a-563abc554b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9802c10d-feae-4f8c-845a-563abc554b9b', 'volume_size': 1} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:34 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.177s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1103392440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b4d295-3bcb-4e55-9e4a-a914bf58a0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:32Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Creating volume 74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:34 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77707a29-c1e5-47b4-a3bd-b16658c5d775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd6d27c-fec5-4408-9e8a-9aa2f367081b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:34 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 1073741824 Sep 10 20:26:34 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:34 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Volume volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 (6d73f800-d35f-4a47-8a1f-6edd952d2d30): created successfully Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd6d27c-fec5-4408-9e8a-9aa2f367081b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (d1bde60e-1fa3-49de-8284-17040d6722d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edf00f8-4d8c-49a4-bc14-af4c5c90b96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6ffb061-681b-4cd0-8722-21a2274948da', 'volume_name': 'volume-f6ffb061-681b-4cd0-8722-21a2274948da', 'volume_size': 1, 'image_id': 'e420fa87-a881-47d6-990f-5e85abb70c15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e420fa87-a881-47d6-990f-5e85abb70c15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ec75349be1afa2d89223d9ab618e94e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3089c0ad4c17442b88fdbb789537134d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fd73d2ed7379ff635688dc0ee9c23c91119d6d1e579e3e7a49af8e701a0ca91e121362110ad6616df0000a2f7bf4be637a427936627f5edaf2f86dbffe80945', 'id': 'e420fa87-a881-47d6-990f-5e85abb70c15', 'created_at': datetime.datetime(2026, 9, 10, 18, 26, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 26, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e420fa87-a881-47d6-990f-5e85abb70c15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c346b0d7-03e5-44e5-aafd-55b5a988c8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c346b0d7-03e5-44e5-aafd-55b5a988c8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319fb30a-7f7c-426a-b360-19e7077b4d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Volume f6ffb061-681b-4cd0-8722-21a2274948da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6ffb061-681b-4cd0-8722-21a2274948da', 'volume_size': 1, 'image_id': 'e420fa87-a881-47d6-990f-5e85abb70c15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e420fa87-a881-47d6-990f-5e85abb70c15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ec75349be1afa2d89223d9ab618e94e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3089c0ad4c17442b88fdbb789537134d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fd73d2ed7379ff635688dc0ee9c23c91119d6d1e579e3e7a49af8e701a0ca91e121362110ad6616df0000a2f7bf4be637a427936627f5edaf2f86dbffe80945', 'id': 'e420fa87-a881-47d6-990f-5e85abb70c15', 'created_at': datetime.datetime(2026, 9, 10, 18, 26, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 26, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e420fa87-a881-47d6-990f-5e85abb70c15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Trying to clone f6ffb061-681b-4cd0-8722-21a2274948da from image e420fa87-a881-47d6-990f-5e85abb70c15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e420fa87-a881-47d6-990f-5e85abb70c15', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:26:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9381f058-4c4e-4bf0-9283-04de21ec592c tempest-CreateVolumesFromImageTest-1419283597 None] Created volume successfully. Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:26:35 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Image download 0.00 MB at 0.00 MB/s Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71c251-a8c1-4365-9a45-a00922c2f669]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (70abc669-4bcc-4689-981d-f3e32e778a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97da3edd-d857-463b-a516-44aa1f5bd512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD Sep 10 20:26:35 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97da3edd-d857-463b-a516-44aa1f5bd512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312268312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:35Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6a21c-7d73-4f1c-8956-61336d038eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6a21c-7d73-4f1c-8956-61336d038eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd1bfd7-d1f2-4d3b-b3cd-349a7e8a9f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd1bfd7-d1f2-4d3b-b3cd-349a7e8a9f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a', 'volume_name': 'volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a58158f-c905-4956-bb85-bc02ad26ef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a58158f-c905-4956-bb85-bc02ad26ef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5b9908-34b0-4e32-9a22-74154dd992d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a', 'volume_size': 1} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:35 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 1073741824" returned: 0 in 0.640s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:35 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:35 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 Sep 10 20:26:35 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:35 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD Sep 10 20:26:35 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (c3a30467-9868-4ef3-a3e9-2c586b9bc606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09200085-3b8e-4e33-95bd-a9648aa9a33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09200085-3b8e-4e33-95bd-a9648aa9a33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1004507145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93acb004-eba0-47b0-b52a-3a044a4e30e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:36Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664d9f1f-82bb-4f99-b440-aa9d52edb715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664d9f1f-82bb-4f99-b440-aa9d52edb715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62516d78-6674-42af-9a04-e0cad5e70a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62516d78-6674-42af-9a04-e0cad5e70a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93acb004-eba0-47b0-b52a-3a044a4e30e0', 'volume_name': 'volume-93acb004-eba0-47b0-b52a-3a044a4e30e0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa3d0af-f271-4ff6-905f-1a0b3ff31f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa3d0af-f271-4ff6-905f-1a0b3ff31f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2423d635-8455-4ec3-983f-49fd22d98857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:35 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume 93acb004-eba0-47b0-b52a-3a044a4e30e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93acb004-eba0-47b0-b52a-3a044a4e30e0', 'volume_size': 1} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:35 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0" returned: 0 in 0.349s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.870s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1674831947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41985e80-5cfa-4f3d-bf1a-38e7b09a08d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18163768f2ec48a7b6cb789cf0304fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:32Z,use_quota=True,user_id='8965c6fd673e4c3e85a24e4480bf216d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Creating volume 41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:35 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a714c1-0b9a-4261-bd96-82d6c663b084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:36 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90519883-e2b4-4cdf-a1bd-ea46506a8bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:36 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 1073741824 Sep 10 20:26:36 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD" returned: 1 in 0.439s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Temporary image e420fa87-a881-47d6-990f-5e85abb70c15 is fetched for user 038479cc71d4435e9192a3b9d14068d5. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:26:36 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Volume volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 (74b4d295-3bcb-4e55-9e4a-a914bf58a0a0): created successfully Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90519883-e2b4-4cdf-a1bd-ea46506a8bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (2bb587a4-eebc-4226-aae7-03751f827dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2293175e-f4e3-4a6f-b509-fd6cc89445ad tempest-CreateVolumesFromImageTest-1419283597 None] Created volume successfully. Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (ee8d91de-a3b4-4b48-b2d1-26268716b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db96f4b-cca8-44bd-9aad-cb0e8e76fe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b971d-e00c-4700-b644-02548b0be453]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db96f4b-cca8-44bd-9aad-cb0e8e76fe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872362770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71b68aa-e041-4d81-bd85-b679481b1f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:36Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2588f8-2f90-4a28-af65-5e9407728a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2588f8-2f90-4a28-af65-5e9407728a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06ebed9-7e34-4e1d-828a-c79ae21389cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06ebed9-7e34-4e1d-828a-c79ae21389cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71b68aa-e041-4d81-bd85-b679481b1f51', 'volume_name': 'volume-c71b68aa-e041-4d81-bd85-b679481b1f51', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba00a21-8398-4f23-b5b2-b95b8240d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba00a21-8398-4f23-b5b2-b95b8240d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe24814-3d41-45a0-9696-642019a2bba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:36 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume c71b68aa-e041-4d81-bd85-b679481b1f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71b68aa-e041-4d81-bd85-b679481b1f51', 'volume_size': 1} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:36 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD Sep 10 20:26:36 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:36 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 1073741824" returned: 0 in 0.443s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:36 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 Sep 10 20:26:36 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:36 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:36 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD Sep 10 20:26:36 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:36 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9" returned: 0 in 0.266s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.348s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Creating offline snapshot 8baaeb62-a3cd-4e85-a05a-0b8272e711aa of volume b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a530519-5591-4d80-bdb3-9c4e3bcae738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc18971-ddc1-4b62-b38f-d2a0f8a18f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[81284a63-1cc3-4b83-af12-c40f0540d346]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:36 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Volume volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 (41985e80-5cfa-4f3d-bf1a-38e7b09a08d9): created successfully Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc18971-ddc1-4b62-b38f-d2a0f8a18f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Flow 'volume_create_manager' (4c06d8d2-518c-457b-84d1-84ffcec61c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9b944cb8-afab-45c9-9b78-188da17a4e56 tempest-CreateVolumesFromImageTest-1419283597 None] Created volume successfully. Sep 10 20:26:36 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD" returned: 1 in 0.374s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:26:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:36 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 Sep 10 20:26:36 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:37 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3" returned: 0 in 0.378s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:37 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa 1G Sep 10 20:26:37 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:37 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa 1G" returned: 0 in 0.398s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:37 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa Sep 10 20:26:37 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-quobyte-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf2cc8-f353-45a5-a314-7007eddddf9f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:37 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa" returned: 0 in 0.337s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:37 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa is being set with open permissions: ugo+rw Sep 10 20:26:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:37 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa Sep 10 20:26:37 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:38 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 Sep 10 20:26:38 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:38 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa" returned: 0 in 0.254s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:38 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.info Sep 10 20:26:38 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:38 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9" returned: 0 in 0.385s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:38 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9 Sep 10 20:26:38 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:38 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.info" returned: 0 in 0.289s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:38 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.info is being set with open permissions: ugo+rw Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:38 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.info Sep 10 20:26:38 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:38 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9" returned: 0 in 0.253s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9" released by "delete_volume" :: held 0.686s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Created reservations ['a4daa85d-30f3-4934-9f44-f4d1c8d5c7a9', '2bbad3a5-7bd5-4a46-b97a-3b4a4b1b7c06', 'b06cf15d-0d9e-4c2c-94e7-d8b42b39100b', '5f661851-1675-4f40-9b5e-e77f82ad9ae8'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:38 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:38 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:38 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.info" returned: 0 in 0.260s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.282s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-254428786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c23b39-edf9-4073-9209-cb560c190bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:34Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Creating volume b2c23b39-edf9-4073-9209-cb560c190bb7 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:38 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:38 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7 1073741824 Sep 10 20:26:38 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-273c5a85-6b92-42b8-b134-7be17bbb186a tempest-VolumeDependencyTests-1565007565 None] Create snapshot completed successfully Sep 10 20:26:38 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.263s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Deleted volume successfully. Sep 10 20:26:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-49c85837-7569-4144-b7fd-0901a02434aa tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-41985e80-5cfa-4f3d-bf1a-38e7b09a08d9-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-quobyte-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[52110cf7-c738-43e8-bbec-e654d32de9df]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:39 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 Sep 10 20:26:39 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:39 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7 1073741824" returned: 0 in 0.489s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:39 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7 Sep 10 20:26:39 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:39 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0" returned: 0 in 0.386s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:39 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0 Sep 10 20:26:39 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:39 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7" returned: 0 in 0.267s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.729s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110174767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9802c10d-feae-4f8c-845a-563abc554b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:35Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Creating volume 9802c10d-feae-4f8c-845a-563abc554b9b {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:39 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:39 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b 1073741824 Sep 10 20:26:39 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a805cf8-dcff-4399-a097-d08a895c718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c23b39-edf9-4073-9209-cb560c190bb7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13161f4-a9b8-4dc0-9627-dd1b6a96fce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:39 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume volume-b2c23b39-edf9-4073-9209-cb560c190bb7 (b2c23b39-edf9-4073-9209-cb560c190bb7): created successfully Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13161f4-a9b8-4dc0-9627-dd1b6a96fce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (1d3a6dd5-a9c2-4bad-9835-5aa13206d57c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2c3b3ece-34c6-46f9-9c83-fb97669d1e49 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created volume successfully. Sep 10 20:26:39 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0" returned: 0 in 0.292s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0" released by "delete_volume" :: held 0.721s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Created reservations ['010f5443-c5bc-40af-a0b5-39660ef855de', 'ebe50e2b-217a-4314-863a-302b52e7118a', 'cd8318e5-8bd3-47c9-bf61-99b914116d34', '8d5367fe-01c7-4937-90f6-3a73cba12446'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:39 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:39 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:40 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b 1073741824" returned: 0 in 0.543s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:40 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b Sep 10 20:26:40 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-6d73f800-d35f-4a47-8a1f-6edd952d2d30-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:40 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.347s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-6d73f800-d35f-4a47-8a1f-6edd952d2d30-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:40 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Deleted volume successfully. Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-quobyte-6d73f800-d35f-4a47-8a1f-6edd952d2d30" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c9cf145-a490-4ae3-a8e6-d93fa7701ab1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-74b4d295-3bcb-4e55-9e4a-a914bf58a0a0-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-6d73f800-d35f-4a47-8a1f-6edd952d2d30" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efe82e2-255d-42b8-a7d4-a15572797a7b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:40 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 Sep 10 20:26:40 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:40 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b" returned: 0 in 0.352s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.203s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312268312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:35Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Creating volume ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:40 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:40 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a 1073741824 Sep 10 20:26:40 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ec84a5-ba74-4dbf-8458-6e1df4050cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9802c10d-feae-4f8c-845a-563abc554b9b', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d1c929-6410-4970-b17f-56e87579199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:40 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume volume-9802c10d-feae-4f8c-845a-563abc554b9b (9802c10d-feae-4f8c-845a-563abc554b9b): created successfully Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d1c929-6410-4970-b17f-56e87579199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (2f39d2ad-c397-4a36-b7af-943e470415e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:40 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2af192f9-b0e0-4db1-a1dd-b4985fae429e tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created volume successfully. Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Flow 'volume_create_manager' (a69d0cf6-32af-4d57-8890-24400fa556cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a17ecb3-c6bf-411f-8029-05178a33eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a17ecb3-c6bf-411f-8029-05178a33eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-210642107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68080f90-a4c7-42aa-9a40-c41329588120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9a5ddfb68b492ba1717fba6c970165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8baaeb62-a3cd-4e85-a05a-0b8272e711aa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:41Z,use_quota=True,user_id='6db844aa45ec4ec19d863878b77adbe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba87fb52-a160-4c5a-b121-ba6a20ead149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba87fb52-a160-4c5a-b121-ba6a20ead149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7ba1a7-a472-44cd-b845-cf4a89af6cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7ba1a7-a472-44cd-b845-cf4a89af6cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68080f90-a4c7-42aa-9a40-c41329588120', 'volume_name': 'volume-68080f90-a4c7-42aa-9a40-c41329588120', 'volume_size': 1, 'snapshot_id': '8baaeb62-a3cd-4e85-a05a-0b8272e711aa'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3be7395-cb30-46d2-81c2-11e23a930d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3be7395-cb30-46d2-81c2-11e23a930d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d87ed90-878a-443d-b411-a48b563bd786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:40 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Volume 68080f90-a4c7-42aa-9a40-c41329588120: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68080f90-a4c7-42aa-9a40-c41329588120', 'volume_size': 1, 'snapshot_id': '8baaeb62-a3cd-4e85-a05a-0b8272e711aa'} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:40 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30" returned: 0 in 0.414s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:40 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30 Sep 10 20:26:40 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:41 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a 1073741824" returned: 0 in 0.458s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:41 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6d73f800-d35f-4a47-8a1f-6edd952d2d30" returned: 0 in 0.272s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:41 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a Sep 10 20:26:41 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-6d73f800-d35f-4a47-8a1f-6edd952d2d30" released by "delete_volume" :: held 0.749s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Created reservations ['be8eea5d-d89c-4e16-8835-d3fdd1c8bc3b', '4d5b1112-7240-4ef8-a8f7-92f18e924510', '52ada95f-8153-4be0-ba41-821853b93fd2', '96fdf7bb-9fcf-4544-9921-56c17e0c8ffe'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:41 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:41 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:41 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a" returned: 0 in 0.256s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.471s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1004507145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93acb004-eba0-47b0-b52a-3a044a4e30e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:36Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Creating volume 93acb004-eba0-47b0-b52a-3a044a4e30e0 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:41 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5b9908-34b0-4e32-9a22-74154dd992d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:41 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 1073741824 Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801a9f47-d52f-40a9-8643-f93dcd36185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:41 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:41 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a (ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a): created successfully Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801a9f47-d52f-40a9-8643-f93dcd36185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (70abc669-4bcc-4689-981d-f3e32e778a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-66d67ac7-ae9f-4a64-af33-3ef9e9918ece tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created volume successfully. Sep 10 20:26:41 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.271s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Deleted volume successfully. Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-90c9e532-6c16-4eb5-bfb9-3169945bdbe4 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-6d73f800-d35f-4a47-8a1f-6edd952d2d30-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-71b09cbf-8a88-49a0-94d9-420373c9b76f-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-71b09cbf-8a88-49a0-94d9-420373c9b76f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-quobyte-71b09cbf-8a88-49a0-94d9-420373c9b76f" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-71b09cbf-8a88-49a0-94d9-420373c9b76f" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9ff54f-c037-4224-9c57-587746cb8cb6]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:41 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f Sep 10 20:26:41 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:41 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 1073741824" returned: 0 in 0.474s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:41 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 Sep 10 20:26:41 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:42 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f" returned: 0 in 0.375s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:42 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f Sep 10 20:26:42 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:42 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0" returned: 0 in 0.275s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.903s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872362770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71b68aa-e041-4d81-bd85-b679481b1f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8928871054fa49b37ec23c5f6c70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:36Z,use_quota=True,user_id='cfde751b138c4d62b476a84f917f9185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Creating volume c71b68aa-e041-4d81-bd85-b679481b1f51 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:42 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2423d635-8455-4ec3-983f-49fd22d98857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93acb004-eba0-47b0-b52a-3a044a4e30e0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f094164-ecd6-4d00-87dd-539e746b17bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:42 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51 1073741824 Sep 10 20:26:42 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:42 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 (93acb004-eba0-47b0-b52a-3a044a4e30e0): created successfully Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f094164-ecd6-4d00-87dd-539e746b17bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (c3a30467-9868-4ef3-a3e9-2c586b9bc606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:42 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3ce152c6-bd6e-4923-a45f-8d4545bacb2f tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created volume successfully. Sep 10 20:26:42 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-71b09cbf-8a88-49a0-94d9-420373c9b76f" returned: 0 in 0.265s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-71b09cbf-8a88-49a0-94d9-420373c9b76f" released by "delete_volume" :: held 0.681s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Created reservations ['6aed1280-ae7d-4b14-a462-edb78d543a06', '3de1974f-a720-4091-a819-f07731847ff8', '079e406a-66f2-4e75-835c-cbd09c5d6179', '80c6b5f5-bc27-4680-b029-5bd5a2f80c0a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:42 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:42 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:42 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51 1073741824" returned: 0 in 0.514s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:42 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.277s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:42 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Deleted volume successfully. Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c0289060-9b0e-4307-b2b4-c40cab6e63f1 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-71b09cbf-8a88-49a0-94d9-420373c9b76f-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:42 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51 Sep 10 20:26:42 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-c7719324-692c-40e8-922d-dae15d1adf49-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-c7719324-692c-40e8-922d-dae15d1adf49-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "cinder-quobyte-c7719324-692c-40e8-922d-dae15d1adf49" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-c7719324-692c-40e8-922d-dae15d1adf49" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d112933-5d78-47af-a807-5703bfc0d922]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:43 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51" returned: 0 in 0.300s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.236s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ffb061-681b-4cd0-8722-21a2274948da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3089c0ad4c17442b88fdbb789537134d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:34Z,use_quota=True,user_id='038479cc71d4435e9192a3b9d14068d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a14ce68-607e-4811-886c-c08074084c3b),volume_type_id=3a14ce68-607e-4811-886c-c08074084c3b)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Creating volume f6ffb061-681b-4cd0-8722-21a2274948da {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:43 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe24814-3d41-45a0-9696-642019a2bba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71b68aa-e041-4d81-bd85-b679481b1f51', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2059af85-bf61-4130-a761-9ff9f030aa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:43 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da 1073741824 Sep 10 20:26:43 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:43 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Volume volume-c71b68aa-e041-4d81-bd85-b679481b1f51 (c71b68aa-e041-4d81-bd85-b679481b1f51): created successfully Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2059af85-bf61-4130-a761-9ff9f030aa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Flow 'volume_create_manager' (ee8d91de-a3b4-4b48-b2d1-26268716b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:43 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2130b5a4-2f27-4dd2-85a7-7fccb618e04b tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created volume successfully. Sep 10 20:26:43 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49 Sep 10 20:26:43 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:43 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49" returned: 0 in 0.386s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:43 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49 Sep 10 20:26:43 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:43 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da 1073741824" returned: 0 in 0.449s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:43 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da Sep 10 20:26:43 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:43 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c7719324-692c-40e8-922d-dae15d1adf49" returned: 0 in 0.260s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-quobyte-c7719324-692c-40e8-922d-dae15d1adf49" released by "delete_volume" :: held 0.689s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Created reservations ['1b079f83-13a2-49b4-aac8-63dcd869a6b3', 'fbfb3622-f010-413b-a417-3f8b7be3ef9a', 'd820a7e9-6885-4f1d-bf45-5185375ea76d', '8154b3cc-9ead-480f-80ee-bd5961601177'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:43 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da" returned: 0 in 0.287s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.124s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "cinder-quobyte-8baaeb62-a3cd-4e85-a05a-0b8272e711aa-68080f90-a4c7-42aa-9a40-c41329588120" by "_create_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:43 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:43 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-8baaeb62-a3cd-4e85-a05a-0b8272e711aa-68080f90-a4c7-42aa-9a40-c41329588120" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Creating volume 68080f90-a4c7-42aa-9a40-c41329588120 from snapshot 8baaeb62-a3cd-4e85-a05a-0b8272e711aa {{(pid=88137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "cinder-quobyte-68080f90-a4c7-42aa-9a40-c41329588120" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-c71b68aa-e041-4d81-bd85-b679481b1f51-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Attempting download of e420fa87-a881-47d6-990f-5e85abb70c15 ((None, [{'url': 'file:///opt/stack/data/glance/images/e420fa87-a881-47d6-990f-5e85abb70c15', 'metadata': {}}])) to volume f6ffb061-681b-4cd0-8722-21a2274948da. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-68080f90-a4c7-42aa-9a40-c41329588120" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] snapshot: 8baaeb62-a3cd-4e85-a05a-0b8272e711aa, volume: 68080f90-a4c7-42aa-9a40-c41329588120, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-c71b68aa-e041-4d81-bd85-b679481b1f51-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f890ba7c-8515-40ea-a5d3-31490b180cdb]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-quobyte-c71b68aa-e041-4d81-bd85-b679481b1f51" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-c71b68aa-e041-4d81-bd85-b679481b1f51" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3377f7-fee3-4542-9a94-7632080cf2aa]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f48cd2-a16f-47dd-80ce-2ff00aebd229]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e420fa87-a881-47d6-990f-5e85abb70c15_gu3jcuqf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:44 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa Sep 10 20:26:44 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:44 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.413s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Deleted volume successfully. Sep 10 20:26:44 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51 Sep 10 20:26:44 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4894c8f9-4495-444c-842b-d84649d45206 tempest-CreateVolumesFromImageTest-1419283597 None] Lock "cinder-c7719324-692c-40e8-922d-dae15d1adf49-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:44 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e420fa87-a881-47d6-990f-5e85abb70c15_gu3jcuqf Sep 10 20:26:44 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:44 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa" returned: 0 in 0.480s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3d6f85-8184-43ff-aee0-bb05cc19cd7b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:44 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e420fa87-a881-47d6-990f-5e85abb70c15_gu3jcuqf" returned: 0 in 0.447s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e420fa87-a881-47d6-990f-5e85abb70c15_gu3jcuqf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:44 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51" returned: 0 in 0.514s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:44 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51 Sep 10 20:26:44 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:44 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 Sep 10 20:26:44 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:44 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e420fa87-a881-47d6-990f-5e85abb70c15_gu3jcuqf Sep 10 20:26:44 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:44 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-c71b68aa-e041-4d81-bd85-b679481b1f51" returned: 0 in 0.278s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-c71b68aa-e041-4d81-bd85-b679481b1f51" released by "delete_volume" :: held 0.843s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:45 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e420fa87-a881-47d6-990f-5e85abb70c15_gu3jcuqf" returned: 1 in 0.366s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e420fa87-a881-47d6-990f-5e85abb70c15_gu3jcuqf' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5888f570-19bd-46dd-8963-45078de2748b]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created reservations ['3d96cf34-2012-4f51-8e86-8459af49ecea', '3b27fbec-6b7b-44dd-98e6-7a9d6d03018d', 'f49f69f1-073e-45bb-84a4-62c8a0a55068', '5f1b0087-9e4e-4df0-a3ca-5d43ac0037b2'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:45 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3" returned: 0 in 0.535s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:45 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 Sep 10 20:26:45 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:45 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD Sep 10 20:26:45 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:45 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:45 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-93acb004-eba0-47b0-b52a-3a044a4e30e0-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-93acb004-eba0-47b0-b52a-3a044a4e30e0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-quobyte-93acb004-eba0-47b0-b52a-3a044a4e30e0" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-93acb004-eba0-47b0-b52a-3a044a4e30e0" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:45 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD" returned: 0 in 0.494s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebdada7-a04a-4b2b-8c30-d1e981a45742]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:45 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.440s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:45 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Deleted volume successfully. Sep 10 20:26:45 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD Sep 10 20:26:45 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:45 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 Sep 10 20:26:45 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ac1616d7-7138-4f2e-991b-6e06bcc85ffa tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-c71b68aa-e041-4d81-bd85-b679481b1f51-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:46 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD" returned: 1 in 0.483s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:26:46 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] e420fa87-a881-47d6-990f-5e85abb70c15 was raw, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:26:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:46 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da Sep 10 20:26:46 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:46 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0" returned: 0 in 0.859s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:46 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0 Sep 10 20:26:46 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:46 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93acb004-eba0-47b0-b52a-3a044a4e30e0" returned: 0 in 0.505s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:46 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-93acb004-eba0-47b0-b52a-3a044a4e30e0" released by "delete_volume" :: held 1.468s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created reservations ['b8985a67-ed27-4191-80b0-8688dd21081e', '133314b9-5b84-4362-801c-e4df1e0468b3', '0eeb0f70-8883-4af9-82b7-1ac383b4e0c3', '511f7a75-f5b4-42ff-a391-2214284fb492'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:47 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:47 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:47 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da" returned: 0 in 1.504s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e420fa87-a881-47d6-990f-5e85abb70c15_2j9otvv9devstack@QuobyteHD, size 0.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:26:47 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:47 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da 1G Sep 10 20:26:47 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-quobyte-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a" acquired by "delete_volume" :: waited 0.043s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4101c2-da56-44c1-b85e-95c1069950d7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:48 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.929s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Deleted volume successfully. Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0799f97a-6d17-4033-a41a-1a1be4d32ba7 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-93acb004-eba0-47b0-b52a-3a044a4e30e0-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:48 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da 1G" returned: 0 in 0.857s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Downloaded image e420fa87-a881-47d6-990f-5e85abb70c15 ((None, [{'url': 'file:///opt/stack/data/glance/images/e420fa87-a881-47d6-990f-5e85abb70c15', 'metadata': {}}])) to volume f6ffb061-681b-4cd0-8722-21a2274948da successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Temporary image e420fa87-a881-47d6-990f-5e85abb70c15 for user 038479cc71d4435e9192a3b9d14068d5 is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Marking volume f6ffb061-681b-4cd0-8722-21a2274948da as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Copying metadata from image e420fa87-a881-47d6-990f-5e85abb70c15 to f6ffb061-681b-4cd0-8722-21a2274948da. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Creating volume glance metadata for volume f6ffb061-681b-4cd0-8722-21a2274948da backed by image e420fa87-a881-47d6-990f-5e85abb70c15 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e420fa87-a881-47d6-990f-5e85abb70c15', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2ec75349be1afa2d89223d9ab618e94e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:26:48 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a Sep 10 20:26:48 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319fb30a-7f7c-426a-b360-19e7077b4d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ffb061-681b-4cd0-8722-21a2274948da', 'volume_size': 1, 'image_id': 'e420fa87-a881-47d6-990f-5e85abb70c15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e420fa87-a881-47d6-990f-5e85abb70c15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ec75349be1afa2d89223d9ab618e94e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3089c0ad4c17442b88fdbb789537134d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fd73d2ed7379ff635688dc0ee9c23c91119d6d1e579e3e7a49af8e701a0ca91e121362110ad6616df0000a2f7bf4be637a427936627f5edaf2f86dbffe80945', 'id': 'e420fa87-a881-47d6-990f-5e85abb70c15', 'created_at': datetime.datetime(2026, 9, 10, 18, 26, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 26, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e420fa87-a881-47d6-990f-5e85abb70c15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cffc4d8-65d8-4c8a-b15a-e413bdc02a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:48 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Volume volume-f6ffb061-681b-4cd0-8722-21a2274948da (f6ffb061-681b-4cd0-8722-21a2274948da): created successfully Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cffc4d8-65d8-4c8a-b15a-e413bdc02a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:48 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Flow 'volume_create_manager' (20032d77-2dea-4441-9a32-2da49a4f6263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:48 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-05e75ec0-59b2-4cb9-89f2-c40bea17def6 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Created volume successfully. Sep 10 20:26:49 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a" returned: 0 in 0.864s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Acquiring lock "cinder-f6ffb061-681b-4cd0-8722-21a2274948da-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:49 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a Sep 10 20:26:49 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "cinder-f6ffb061-681b-4cd0-8722-21a2274948da-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Acquiring lock "cinder-quobyte-f6ffb061-681b-4cd0-8722-21a2274948da" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "cinder-quobyte-f6ffb061-681b-4cd0-8722-21a2274948da" acquired by "delete_volume" :: waited 0.039s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:49 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[83577bb1-ecce-4e58-b099-a27b88b8f4b5]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:49 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da Sep 10 20:26:49 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:50 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a" returned: 0 in 1.036s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a" released by "delete_volume" :: held 2.029s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created reservations ['9d1b3a7a-0b20-40a7-bec6-c50d1e492bc4', 'f92341ec-b723-4840-8890-9010c8579e0a', '2fb0a3f9-feb5-4a88-b2c0-4eee8618fe9f', '165fe702-5608-4c6a-9462-1f361efc4e72'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:50 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da" returned: 0 in 1.047s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:50 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da Sep 10 20:26:50 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:50 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:50 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-9802c10d-feae-4f8c-845a-563abc554b9b-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (3ada5709-ec18-458c-815e-eaaa4579cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9be68e-c584-4b16-902d-1d491fb2fa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-9802c10d-feae-4f8c-845a-563abc554b9b-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9be68e-c584-4b16-902d-1d491fb2fa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-909382879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece8312e-1c38-4967-bdb4-c23e91838d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:51Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c487f68a-db5e-4876-9f06-28dfe818217a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c487f68a-db5e-4876-9f06-28dfe818217a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a820c83-bef2-4953-b1d7-9f37b6610d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a820c83-bef2-4953-b1d7-9f37b6610d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece8312e-1c38-4967-bdb4-c23e91838d92', 'volume_name': 'volume-ece8312e-1c38-4967-bdb4-c23e91838d92', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec4cad0-2393-453b-a18f-07d4821d0b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:51 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:51 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec4cad0-2393-453b-a18f-07d4821d0b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:51 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e58b0b2-f888-44f7-b67a-e656c96f5568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume ece8312e-1c38-4967-bdb4-c23e91838d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece8312e-1c38-4967-bdb4-c23e91838d92', 'volume_size': 1} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f6ffb061-681b-4cd0-8722-21a2274948da" returned: 0 in 1.255s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 1.100s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120" returned: 0 in 6.651s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:26:51 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Converted 1024.00 MB image at 153.70 MB/s Sep 10 20:26:51 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 is being set with open permissions: ugo+rw Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Deleted volume successfully. Sep 10 20:26:51 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 Sep 10 20:26:51 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "cinder-quobyte-f6ffb061-681b-4cd0-8722-21a2274948da" released by "delete_volume" :: held 2.415s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fbc15ea3-908f-41f4-b137-dc59aa6bb70c tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-ba43aef8-4b02-4af9-9c7e-5cc1d4c73a1a-delete_volume" released by "delete_volume" :: held 3.831s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-quobyte-9802c10d-feae-4f8c-845a-563abc554b9b" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-9802c10d-feae-4f8c-845a-563abc554b9b" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8ca4f4-95ad-48e4-baa8-b0748be154b7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:51 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Created reservations ['52e6a029-4964-45fc-b6cd-55dd4c106eac', '8e596eed-5103-4c47-8c2c-866ce55ca459', '776852b7-840e-4471-88f9-c8e9276da3b1', 'b965576e-6768-47e4-bd72-8abc86550cc1'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:52 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b Sep 10 20:26:52 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:52 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:52 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:52 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120" returned: 0 in 0.287s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-68080f90-a4c7-42aa-9a40-c41329588120" released by "_copy_volume_from_snapshot" :: held 8.101s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-8baaeb62-a3cd-4e85-a05a-0b8272e711aa-68080f90-a4c7-42aa-9a40-c41329588120" released by "_create_volume_from_snapshot" :: held 8.186s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.217s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-909382879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece8312e-1c38-4967-bdb4-c23e91838d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:51Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Creating volume ece8312e-1c38-4967-bdb4-c23e91838d92 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:52 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:52 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 1073741824 Sep 10 20:26:52 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d87ed90-878a-443d-b411-a48b563bd786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68080f90-a4c7-42aa-9a40-c41329588120', 'volume_size': 1, 'snapshot_id': '8baaeb62-a3cd-4e85-a05a-0b8272e711aa'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8979e10f-a84e-4db8-a83d-0d5ec9025a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:52 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Volume volume-68080f90-a4c7-42aa-9a40-c41329588120 (68080f90-a4c7-42aa-9a40-c41329588120): created successfully Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8979e10f-a84e-4db8-a83d-0d5ec9025a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Flow 'volume_create_manager' (a69d0cf6-32af-4d57-8890-24400fa556cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:52 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a4be8f1f-38d4-43bc-9fb1-c703ee53d36d tempest-VolumeDependencyTests-1565007565 None] Created volume successfully. Sep 10 20:26:52 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.263s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:52 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Deleted volume successfully. Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-dfeddbdd-9b24-43e8-b189-b2e4d87cf9e8 tempest-VolumeAndVolumeTypeFromImageTest-142857908 None] Lock "cinder-f6ffb061-681b-4cd0-8722-21a2274948da-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:52 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b" returned: 0 in 0.408s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:52 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b Sep 10 20:26:52 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:52 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9802c10d-feae-4f8c-845a-563abc554b9b" returned: 0 in 0.252s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-9802c10d-feae-4f8c-845a-563abc554b9b" released by "delete_volume" :: held 0.711s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:52 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 1073741824" returned: 0 in 0.498s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created reservations ['00426d3b-fca1-49e0-b494-99c65c255b88', '23ac69e5-3948-4d69-b14e-40be58e2ca3c', '070a2944-fe66-4d70-bec7-369cfb957391', 'fe7b9ebc-4991-4277-88ae-4135c01982ed'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:52 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 Sep 10 20:26:52 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:52 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:52 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-b2c23b39-edf9-4073-9209-cb560c190bb7-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-b2c23b39-edf9-4073-9209-cb560c190bb7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "cinder-8baaeb62-a3cd-4e85-a05a-0b8272e711aa-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-quobyte-b2c23b39-edf9-4073-9209-cb560c190bb7" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-8baaeb62-a3cd-4e85-a05a-0b8272e711aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "cinder-quobyte-b97c2a29-7f53-4c62-8856-fa61c98f30f3" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-b2c23b39-edf9-4073-9209-cb560c190bb7" acquired by "delete_volume" :: waited 0.050s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:53 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-b97c2a29-7f53-4c62-8856-fa61c98f30f3" acquired by "delete_snapshot" :: waited 0.061s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:53 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "cinder-quobyte-8baaeb62-a3cd-4e85-a05a-0b8272e711aa" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.330s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92" returned: 0 in 0.395s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc17bb0e-f618-44c9-b516-0b25811c4bca]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Deleted volume successfully. Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-8baaeb62-a3cd-4e85-a05a-0b8272e711aa" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Deleting offline snapshot 8baaeb62-a3cd-4e85-a05a-0b8272e711aa of volume b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] snapshot_file for this snap is: volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e58b0b2-f888-44f7-b67a-e656c96f5568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece8312e-1c38-4967-bdb4-c23e91838d92', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e589c1d-0357-44c0-80fd-262c7ce985fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fde073-27ed-41fb-a4aa-0d4c3b115728]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:53 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume volume-ece8312e-1c38-4967-bdb4-c23e91838d92 (ece8312e-1c38-4967-bdb4-c23e91838d92): created successfully Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e589c1d-0357-44c0-80fd-262c7ce985fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (3ada5709-ec18-458c-815e-eaaa4579cb90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-de56612b-2c9a-4ba8-9d0c-485bfa877140 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-9802c10d-feae-4f8c-845a-563abc554b9b-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-72bf767f-32e2-40e0-b4aa-41ce788743ad tempest-CreateVolumesFromSnapshotTest-63604132 None] Created volume successfully. Sep 10 20:26:53 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7 Sep 10 20:26:53 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:53 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa Sep 10 20:26:53 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:53 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7" returned: 0 in 0.409s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:53 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7 Sep 10 20:26:53 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:53 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa" returned: 0 in 0.469s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[db45c048-a693-4009-aac1-721562fa384e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:53 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 Sep 10 20:26:53 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:53 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b2c23b39-edf9-4073-9209-cb560c190bb7" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-b2c23b39-edf9-4073-9209-cb560c190bb7" released by "delete_volume" :: held 0.792s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created reservations ['0be0f8a0-363d-4047-93d5-1c4cb4dfe90c', '0e065157-31c5-45b0-91b6-c7110d489863', 'b5644506-b0e1-408c-92c9-0007a3974271', '5f01fce5-b4c7-44fd-8873-c4e71532cd9f'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:54 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:54 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-98155469-a182-42bd-bc76-be8953f8b337-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-98155469-a182-42bd-bc76-be8953f8b337-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "cinder-quobyte-98155469-a182-42bd-bc76-be8953f8b337" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-98155469-a182-42bd-bc76-be8953f8b337" acquired by "delete_volume" :: waited 0.035s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:54 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.439s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3028f3-a600-4c5f-bbdb-752bc521339d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:54 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Deleted volume successfully. Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:54 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Creating offline snapshot 0b80ab0e-c987-456e-af31-598144e11370 of volume ece8312e-1c38-4967-bdb4-c23e91838d92 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3" returned: 0 in 0.826s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-95ffc0bb-eeb8-4bac-836e-21e3258b0f63 tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-b2c23b39-edf9-4073-9209-cb560c190bb7-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e58f20-d54e-4f37-b425-092a7e625046]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:54 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa Sep 10 20:26:54 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:54 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337 Sep 10 20:26:54 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:54 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 Sep 10 20:26:54 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:54 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337" returned: 0 in 0.453s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:54 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337 Sep 10 20:26:54 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:54 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa" returned: 0 in 0.462s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:54 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92" returned: 0 in 0.457s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:55 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa Sep 10 20:26:55 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:55 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 1G Sep 10 20:26:55 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:55 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-98155469-a182-42bd-bc76-be8953f8b337" returned: 0 in 0.352s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-quobyte-98155469-a182-42bd-bc76-be8953f8b337" released by "delete_volume" :: held 0.887s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Created reservations ['5eb5a45f-0351-46b3-a73a-7b3bbb92246c', 'fde37025-6898-4336-8466-c252d7563b24', 'fb8eb120-f4ec-4e49-8cfa-e3f781600f38', 'd4900072-1cb6-424b-94f6-a0916f960ff1'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:55 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3.8baaeb62-a3cd-4e85-a05a-0b8272e711aa" returned: 0 in 0.357s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-8baaeb62-a3cd-4e85-a05a-0b8272e711aa" released by "_delete_snapshot" :: held 2.269s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-b97c2a29-7f53-4c62-8856-fa61c98f30f3" released by "delete_snapshot" :: held 2.333s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Created reservations ['67e274aa-2b28-40b4-bed3-a73cba15aa99', '4a046050-9391-4d0e-98c0-d4f1edf8504e', '7eb79833-c5f0-4ab7-bd4d-67cdefdecf7e', 'fc62a867-5f35-4c10-bc1a-53bad53188d5'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:55 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:55 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:55 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Delete snapshot completed successfully. Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ff7be54-7910-4c30-9daa-b25f7e13547d tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-8baaeb62-a3cd-4e85-a05a-0b8272e711aa-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:55 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 1G" returned: 0 in 0.670s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece8312e-1c38-4967-bdb4-c23e91838d92 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:55 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece8312e-1c38-4967-bdb4-c23e91838d92 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 Sep 10 20:26:55 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:55 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.278s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:55 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Deleted volume successfully. Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d40a8e23-49bb-4ca4-b47b-22788bed779a tempest-CreateVolumesFromSourceVolumeTest-857997839 None] Lock "cinder-98155469-a182-42bd-bc76-be8953f8b337-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:55 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece8312e-1c38-4967-bdb4-c23e91838d92 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370" returned: 0 in 0.337s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:55 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 is being set with open permissions: ugo+rw Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:56 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 Sep 10 20:26:56 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:56 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370" returned: 0 in 0.305s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "cinder-b97c2a29-7f53-4c62-8856-fa61c98f30f3-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:56 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.info Sep 10 20:26:56 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-b97c2a29-7f53-4c62-8856-fa61c98f30f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "cinder-quobyte-b97c2a29-7f53-4c62-8856-fa61c98f30f3" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-b97c2a29-7f53-4c62-8856-fa61c98f30f3" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[64be35bb-8028-49a9-9df1-bb0d409521a2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:56 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 Sep 10 20:26:56 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:56 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.info" returned: 0 in 0.363s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:56 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.info is being set with open permissions: ugo+rw Sep 10 20:26:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:56 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.info Sep 10 20:26:56 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:57 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3" returned: 0 in 0.437s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:57 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3 Sep 10 20:26:57 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:57 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.info" returned: 0 in 0.322s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-95f94faa-2bf6-48c1-8efe-cd87bb2d2860 tempest-CreateVolumesFromSnapshotTest-63604132 None] Create snapshot completed successfully Sep 10 20:26:57 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-b97c2a29-7f53-4c62-8856-fa61c98f30f3" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-b97c2a29-7f53-4c62-8856-fa61c98f30f3" released by "delete_volume" :: held 0.832s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Created reservations ['59c5c901-cca5-4b99-a0e1-53c9e415c7f5', '9ad7e692-c77a-4193-9266-fc72cb4de18f', '6d1d9f76-26ff-4b87-9438-c41a8faa478e', '8f64f8d7-8374-4954-873d-c2f3cb56620b'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:57 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:57 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "cinder-68080f90-a4c7-42aa-9a40-c41329588120-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-68080f90-a4c7-42aa-9a40-c41329588120-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "cinder-quobyte-68080f90-a4c7-42aa-9a40-c41329588120" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-68080f90-a4c7-42aa-9a40-c41329588120" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570b28b-c857-4a74-95da-2218c30e5784]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:57 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.429s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:57 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Deleted volume successfully. Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d720ade4-90e1-46cf-a810-8a6a8ae8c2f1 tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-b97c2a29-7f53-4c62-8856-fa61c98f30f3-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:58 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 Sep 10 20:26:58 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:58 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120" returned: 0 in 0.523s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:58 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120 Sep 10 20:26:58 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (702b68b0-c17a-4922-95f3-57e1081dc078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a9a48a-ec86-4267-9e1f-b377c3121331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a9a48a-ec86-4267-9e1f-b377c3121331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453362349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4e8cf1-44cf-4e6b-86a5-a4401acce9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:58Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cce5e8a-2b27-4270-b463-b9dd9bd2add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cce5e8a-2b27-4270-b463-b9dd9bd2add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b249915-7c56-4fc3-a111-fc593adee2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b249915-7c56-4fc3-a111-fc593adee2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4e8cf1-44cf-4e6b-86a5-a4401acce9f4', 'volume_name': 'volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec79dc-c269-4c4d-8e68-5e28b1e4f5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec79dc-c269-4c4d-8e68-5e28b1e4f5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da258e54-754e-4c08-9584-f482f0ae347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:58 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume de4e8cf1-44cf-4e6b-86a5-a4401acce9f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4', 'volume_size': 1} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453362349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4e8cf1-44cf-4e6b-86a5-a4401acce9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:58Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Creating volume de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:26:58 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:58 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 1073741824 Sep 10 20:26:58 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:58 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68080f90-a4c7-42aa-9a40-c41329588120" returned: 0 in 0.468s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-quobyte-68080f90-a4c7-42aa-9a40-c41329588120" released by "delete_volume" :: held 1.056s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:58 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Created reservations ['eebcfed9-c67e-4172-be32-3eb375704c83', '9b121e24-36bb-4351-a506-8852a9ba1461', '5d14102d-18f9-4ae5-821e-381b7a95084e', '9bb3761c-6735-4a4d-b6b5-a948601e50d4'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:59 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:26:59 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (7e46b32b-26d6-45d9-9d4d-a40d96d37b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46b1589-d136-4a2e-9c29-c873f6a6772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46b1589-d136-4a2e-9c29-c873f6a6772c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-729705020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bb1bec-0d9a-4497-9f6f-1970e1966448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:59Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06269c4a-bbed-489c-a489-9ceefde16490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06269c4a-bbed-489c-a489-9ceefde16490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2718265b-bc52-45e3-9b6e-b9207e70d258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2718265b-bc52-45e3-9b6e-b9207e70d258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93bb1bec-0d9a-4497-9f6f-1970e1966448', 'volume_name': 'volume-93bb1bec-0d9a-4497-9f6f-1970e1966448', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86a7941-f9cb-4b50-85c8-5513356dfff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86a7941-f9cb-4b50-85c8-5513356dfff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0268d55b-bc64-49bb-b0b4-a12e238f3c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:26:59 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume 93bb1bec-0d9a-4497-9f6f-1970e1966448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93bb1bec-0d9a-4497-9f6f-1970e1966448', 'volume_size': 1} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:26:59 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 1073741824" returned: 0 in 0.810s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:59 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.422s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:26:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Deleted volume successfully. Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-76ec4a87-6f32-4588-baea-9d0d381f6b31 tempest-VolumeDependencyTests-1565007565 None] Lock "cinder-68080f90-a4c7-42aa-9a40-c41329588120-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:26:59 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 Sep 10 20:26:59 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:26:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (bd4fb5d9-6727-4ce2-8fd3-6d6f953db499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5436a26-407f-407e-bd96-f3b4e792d87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5436a26-407f-407e-bd96-f3b4e792d87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-471871784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3282bd6d-bf73-438e-ac64-59a3df0257d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:00Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61c4137-94b6-4d98-b12c-c37f02278a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61c4137-94b6-4d98-b12c-c37f02278a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d3553a-2510-41a4-b2b4-9c1303126d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d3553a-2510-41a4-b2b4-9c1303126d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3282bd6d-bf73-438e-ac64-59a3df0257d3', 'volume_name': 'volume-3282bd6d-bf73-438e-ac64-59a3df0257d3', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db04758a-5412-4533-ac0e-439df21e22a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db04758a-5412-4533-ac0e-439df21e22a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b5f0a0-e365-4654-9303-908d2ca4f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume 3282bd6d-bf73-438e-ac64-59a3df0257d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3282bd6d-bf73-438e-ac64-59a3df0257d3', 'volume_size': 1} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4" returned: 0 in 0.482s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-729705020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bb1bec-0d9a-4497-9f6f-1970e1966448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:26:59Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Creating volume 93bb1bec-0d9a-4497-9f6f-1970e1966448 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:00 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da258e54-754e-4c08-9584-f482f0ae347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494d39af-93a8-4d65-b45e-cbd5810f180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 1073741824 Sep 10 20:27:00 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 (de4e8cf1-44cf-4e6b-86a5-a4401acce9f4): created successfully Sep 10 20:27:00 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494d39af-93a8-4d65-b45e-cbd5810f180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (702b68b0-c17a-4922-95f3-57e1081dc078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:00 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f9625a9f-371e-4833-bebe-8b84258e862a tempest-CreateVolumesFromSnapshotTest-63604132 None] Created volume successfully. Sep 10 20:27:00 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 1073741824" returned: 0 in 0.616s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (f708e7f2-6568-4314-b19f-c2fdf3a70169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9968f4-5606-4ad3-af66-38c62125079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:00 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 Sep 10 20:27:00 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9968f4-5606-4ad3-af66-38c62125079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942482642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353ece41-bcbf-4e8f-913b-a80b70a44952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:01Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318af13d-8438-42dc-b2cd-6f4956080880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318af13d-8438-42dc-b2cd-6f4956080880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3d6f79-47d3-4e2c-8850-2893cf4b0da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3d6f79-47d3-4e2c-8850-2893cf4b0da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353ece41-bcbf-4e8f-913b-a80b70a44952', 'volume_name': 'volume-353ece41-bcbf-4e8f-913b-a80b70a44952', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d26bc1-03cf-4bb9-b29b-b3839ae72396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d26bc1-03cf-4bb9-b29b-b3839ae72396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a300e91-7077-47af-981c-8b65c3204662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:00 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Volume 353ece41-bcbf-4e8f-913b-a80b70a44952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353ece41-bcbf-4e8f-913b-a80b70a44952', 'volume_size': 1} Sep 10 20:27:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (ea743bf2-cf48-4c3a-a335-98da14d2ee20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e534b22-8756-4e8c-88e8-da08f0dfbd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (e33ca672-54ac-4e18-819a-8763f1e7cc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7918b566-34fb-4da1-bfdc-ebda805e17e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e534b22-8756-4e8c-88e8-da08f0dfbd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1688898462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d9255c-5cf6-4da4-a97c-272facf63d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:01Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3408caf8-172f-44bc-91c3-afdfa814d7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3408caf8-172f-44bc-91c3-afdfa814d7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdf0036-42a4-4392-a1ac-aa277d38849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdf0036-42a4-4392-a1ac-aa277d38849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d9255c-5cf6-4da4-a97c-272facf63d6f', 'volume_name': 'volume-46d9255c-5cf6-4da4-a97c-272facf63d6f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc45bc3-a34d-42f5-8362-4956fed3c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc45bc3-a34d-42f5-8362-4956fed3c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fd6016-6044-4714-9671-b7bd9a867389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume 46d9255c-5cf6-4da4-a97c-272facf63d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d9255c-5cf6-4da4-a97c-272facf63d6f', 'volume_size': 1} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7918b566-34fb-4da1-bfdc-ebda805e17e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305024068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fddba5-f1f6-4109-a793-38daa031309f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:01Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce1ee13-4f4b-40c5-beb9-80ffa61f0c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce1ee13-4f4b-40c5-beb9-80ffa61f0c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2c698d-e5c5-4bc9-991c-e1284967a990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2c698d-e5c5-4bc9-991c-e1284967a990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52fddba5-f1f6-4109-a793-38daa031309f', 'volume_name': 'volume-52fddba5-f1f6-4109-a793-38daa031309f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3472f07c-2e13-45ab-8ff8-598179e37ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3472f07c-2e13-45ab-8ff8-598179e37ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc1a48e-317a-4c47-954a-5371ebd35543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume 52fddba5-f1f6-4109-a793-38daa031309f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52fddba5-f1f6-4109-a793-38daa031309f', 'volume_size': 1} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:01 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448" returned: 0 in 0.340s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-471871784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3282bd6d-bf73-438e-ac64-59a3df0257d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:00Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Creating volume 3282bd6d-bf73-438e-ac64-59a3df0257d3 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:01 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0268d55b-bc64-49bb-b0b4-a12e238f3c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bb1bec-0d9a-4497-9f6f-1970e1966448', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c29173-107d-4120-add3-d8b232ba856d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:01 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 1073741824 Sep 10 20:27:01 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:01 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 (93bb1bec-0d9a-4497-9f6f-1970e1966448): created successfully Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c29173-107d-4120-add3-d8b232ba856d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (7e46b32b-26d6-45d9-9d4d-a40d96d37b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2b5b0094-cbe3-4ff0-9221-0d60f1eb9f8e tempest-CreateVolumesFromSnapshotTest-63604132 None] Created volume successfully. Sep 10 20:27:01 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 1073741824" returned: 0 in 0.548s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:01 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 Sep 10 20:27:01 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:02 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3" returned: 0 in 0.292s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.166s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942482642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353ece41-bcbf-4e8f-913b-a80b70a44952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:01Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Creating volume 353ece41-bcbf-4e8f-913b-a80b70a44952 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:02 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b5f0a0-e365-4654-9303-908d2ca4f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3282bd6d-bf73-438e-ac64-59a3df0257d3', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4fd51a-8dd0-4859-8594-1453cb6445ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:02 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 1073741824 Sep 10 20:27:02 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 (3282bd6d-bf73-438e-ac64-59a3df0257d3): created successfully Sep 10 20:27:02 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4fd51a-8dd0-4859-8594-1453cb6445ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (bd4fb5d9-6727-4ce2-8fd3-6d6f953db499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:02 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0b64923b-0c97-4803-bcac-08b840dd884d tempest-CreateVolumesFromSnapshotTest-63604132 None] Created volume successfully. Sep 10 20:27:02 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 1073741824" returned: 0 in 0.628s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:02 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 Sep 10 20:27:02 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:03 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952" returned: 0 in 0.282s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1688898462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d9255c-5cf6-4da4-a97c-272facf63d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:01Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Creating volume 46d9255c-5cf6-4da4-a97c-272facf63d6f {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:03 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a300e91-7077-47af-981c-8b65c3204662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353ece41-bcbf-4e8f-913b-a80b70a44952', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda04afc-6ecf-457f-8baf-6e74de0b2077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:03 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f 1073741824 Sep 10 20:27:03 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:03 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Volume volume-353ece41-bcbf-4e8f-913b-a80b70a44952 (353ece41-bcbf-4e8f-913b-a80b70a44952): created successfully Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda04afc-6ecf-457f-8baf-6e74de0b2077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (f708e7f2-6568-4314-b19f-c2fdf3a70169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:03 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-947f1255-865a-4af7-a62c-cf07c1f26675 tempest-ProjectReaderTests-1085143153 None] Created volume successfully. Sep 10 20:27:03 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f 1073741824" returned: 0 in 0.597s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:03 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f Sep 10 20:27:03 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:04 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f" returned: 0 in 0.279s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.861s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305024068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fddba5-f1f6-4109-a793-38daa031309f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3aae8dfa1f4af195cffda0cb9a0987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:01Z,use_quota=True,user_id='3d449bef4cfb4d1a86551a6876b4dc70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Creating volume 52fddba5-f1f6-4109-a793-38daa031309f {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:04 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fd6016-6044-4714-9671-b7bd9a867389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d9255c-5cf6-4da4-a97c-272facf63d6f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee701b0-4d84-493b-95df-40cd4892c732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:04 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f 1073741824 Sep 10 20:27:04 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:04 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume volume-46d9255c-5cf6-4da4-a97c-272facf63d6f (46d9255c-5cf6-4da4-a97c-272facf63d6f): created successfully Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee701b0-4d84-493b-95df-40cd4892c732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (ea743bf2-cf48-4c3a-a335-98da14d2ee20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:04 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3196285b-d196-4ba3-8d37-10506f408399 tempest-CreateVolumesFromSnapshotTest-63604132 None] Created volume successfully. Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Flow 'volume_create_manager' (aab20580-c5c7-424a-b154-b50d3a33a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9f50d6-c80b-4abe-9ab8-8cefff6dda9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9f50d6-c80b-4abe-9ab8-8cefff6dda9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123c809b-8f45-4ffc-ab0c-82fd682297be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7150ff66e1944e0ba6d101f781b2ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:04Z,use_quota=True,user_id='431f55dd3a86471895cc1e533a611b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855cf861-67ec-4c79-b147-7b1fe955366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855cf861-67ec-4c79-b147-7b1fe955366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1d9e34-170f-4476-a052-3bf551c70b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.image.glance [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Creating Keystone auth plugin from conf {{(pid=88137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:04 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f 1073741824" returned: 0 in 0.688s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:04 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f Sep 10 20:27:04 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (10c5f1e5-928e-4fc0-b7cc-e76e56c5266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b21531-8616-4b1d-8d90-cc5c24177a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b21531-8616-4b1d-8d90-cc5c24177a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1146778278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151361e2-fabd-4011-a5d6-12181cee2461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:05Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b95bfd6-ee3f-4156-8eb9-9c77287861f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b95bfd6-ee3f-4156-8eb9-9c77287861f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5647ba7-1fa4-4616-8fec-ce9e5054e8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5647ba7-1fa4-4616-8fec-ce9e5054e8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151361e2-fabd-4011-a5d6-12181cee2461', 'volume_name': 'volume-151361e2-fabd-4011-a5d6-12181cee2461', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a47759-46e5-431a-830d-272032ada630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a47759-46e5-431a-830d-272032ada630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84291a09-9c81-4e98-8051-47a7d5cce182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:04 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Volume 151361e2-fabd-4011-a5d6-12181cee2461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151361e2-fabd-4011-a5d6-12181cee2461', 'volume_size': 1} Sep 10 20:27:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1d9e34-170f-4476-a052-3bf551c70b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '123c809b-8f45-4ffc-ab0c-82fd682297be', 'volume_name': 'volume-123c809b-8f45-4ffc-ab0c-82fd682297be', 'volume_size': 1, 'image_id': 'e5368420-41f6-4d3f-8210-94fee6169aa6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5368420-41f6-4d3f-8210-94fee6169aa6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba5c5ecfa859aaf89a25e7a13a3dc3ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e7150ff66e1944e0ba6d101f781b2ad9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2be99fa19957ff5f39a5e94685a1cc5b0c1571dfe2b338845ff79ef0d950bb97a9dfcd7be6b4071e6653d452bb7201b7051d672c436340b53b0d2c1806756e89', 'id': 'e5368420-41f6-4d3f-8210-94fee6169aa6', 'created_at': datetime.datetime(2026, 9, 10, 18, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 27, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5368420-41f6-4d3f-8210-94fee6169aa6/file', 'properties': {}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba10b5f8-36b0-4340-bcf5-592c7234048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba10b5f8-36b0-4340-bcf5-592c7234048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe131fed-20d1-4db7-be1e-8c7ac2633fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:05 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Volume 123c809b-8f45-4ffc-ab0c-82fd682297be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-123c809b-8f45-4ffc-ab0c-82fd682297be', 'volume_size': 1, 'image_id': 'e5368420-41f6-4d3f-8210-94fee6169aa6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5368420-41f6-4d3f-8210-94fee6169aa6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba5c5ecfa859aaf89a25e7a13a3dc3ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e7150ff66e1944e0ba6d101f781b2ad9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2be99fa19957ff5f39a5e94685a1cc5b0c1571dfe2b338845ff79ef0d950bb97a9dfcd7be6b4071e6653d452bb7201b7051d672c436340b53b0d2c1806756e89', 'id': 'e5368420-41f6-4d3f-8210-94fee6169aa6', 'created_at': datetime.datetime(2026, 9, 10, 18, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 27, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5368420-41f6-4d3f-8210-94fee6169aa6/file', 'properties': {}}, 'image_service': } Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Trying to clone 123c809b-8f45-4ffc-ab0c-82fd682297be from image e5368420-41f6-4d3f-8210-94fee6169aa6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5368420-41f6-4d3f-8210-94fee6169aa6', 'metadata': {}}]). {{(pid=88137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 20:27:05 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f" returned: 0 in 0.292s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.425s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc1a48e-317a-4c47-954a-5371ebd35543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52fddba5-f1f6-4109-a793-38daa031309f', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8b95b4-699e-46be-83bd-1cda0cea8c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Creating offline snapshot 0190d2ab-e379-44ad-9be2-229b4c4c07a4 of volume 353ece41-bcbf-4e8f-913b-a80b70a44952 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:05 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Volume volume-52fddba5-f1f6-4109-a793-38daa031309f (52fddba5-f1f6-4109-a793-38daa031309f): created successfully Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8b95b4-699e-46be-83bd-1cda0cea8c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Flow 'volume_create_manager' (e33ca672-54ac-4e18-819a-8763f1e7cc3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 20:27:05 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Image download 0.00 MB at 0.00 MB/s Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a697b0-ec90-4544-8078-bfdb3def7c82]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:05 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-89b79119-1094-439a-bac8-310313127a01 tempest-CreateVolumesFromSnapshotTest-63604132 None] Created volume successfully. Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fbb2f5-e0e2-4cad-ae87-53d8444895b6]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:05 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 Sep 10 20:27:05 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:05 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD Sep 10 20:27:05 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:05 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952" returned: 0 in 0.402s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:05 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:05 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 1G Sep 10 20:27:05 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:05 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD Sep 10 20:27:05 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:05 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:27:05 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Temporary image e5368420-41f6-4d3f-8210-94fee6169aa6 is fetched for user 431f55dd3a86471895cc1e533a611b50. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 20:27:06 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 1G" returned: 0 in 0.457s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-353ece41-bcbf-4e8f-913b-a80b70a44952 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:06 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-353ece41-bcbf-4e8f-913b-a80b70a44952 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 Sep 10 20:27:06 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69aabe4-37f4-4616-b3be-d3a07b7599e5]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-46d9255c-5cf6-4da4-a97c-272facf63d6f-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-46d9255c-5cf6-4da4-a97c-272facf63d6f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-quobyte-46d9255c-5cf6-4da4-a97c-272facf63d6f" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-46d9255c-5cf6-4da4-a97c-272facf63d6f" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:06 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD Sep 10 20:27:06 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e872db71-747c-4d15-baa4-42820a3328c2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:06 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f Sep 10 20:27:06 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:06 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-353ece41-bcbf-4e8f-913b-a80b70a44952 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4" returned: 0 in 0.337s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:06 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 is being set with open permissions: ugo+rw Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:06 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 Sep 10 20:27:06 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:06 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:06 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD Sep 10 20:27:06 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:06 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f" returned: 0 in 0.412s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:06 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:06 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f Sep 10 20:27:06 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4" returned: 0 in 0.316s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:06 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.info Sep 10 20:27:06 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:06 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:06 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46d9255c-5cf6-4da4-a97c-272facf63d6f" returned: 0 in 0.297s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-46d9255c-5cf6-4da4-a97c-272facf63d6f" released by "delete_volume" :: held 0.751s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Created reservations ['0f93aae2-4bf1-40e7-8f7f-51b25489e423', '0d6c7dda-f232-4df6-987c-fc4c2115a55b', 'cccb2640-1330-4038-be2e-fc8d9fae5b6a', '4d3bdde7-a795-48fd-9080-fc62c85949af'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:07 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.info" returned: 0 in 0.314s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:07 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.info is being set with open permissions: ugo+rw Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:07 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.info Sep 10 20:27:07 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:07 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:07 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-52fddba5-f1f6-4109-a793-38daa031309f-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:07 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.info" returned: 0 in 0.306s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-52fddba5-f1f6-4109-a793-38daa031309f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.393s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1146778278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151361e2-fabd-4011-a5d6-12181cee2461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:05Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Creating volume 151361e2-fabd-4011-a5d6-12181cee2461 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:07 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:07 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 1073741824 Sep 10 20:27:07 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:07 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b240553f-4fc0-487e-8814-6ab735969a40 tempest-ProjectReaderTests-1085143153 None] Create snapshot completed successfully Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.310s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:07 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Deleted volume successfully. Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-quobyte-52fddba5-f1f6-4109-a793-38daa031309f" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d5957807-6bdf-4942-8b91-cf41ba827d04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-46d9255c-5cf6-4da4-a97c-272facf63d6f-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-52fddba5-f1f6-4109-a793-38daa031309f" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2645fe9d-dc52-40bf-9e00-aae60bbf1c6d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:07 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f Sep 10 20:27:07 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:07 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 1073741824" returned: 0 in 0.515s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:07 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f" returned: 0 in 0.437s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:07 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 Sep 10 20:27:07 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-0190d2ab-e379-44ad-9be2-229b4c4c07a4-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:08 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f Sep 10 20:27:08 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-0190d2ab-e379-44ad-9be2-229b4c4c07a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-353ece41-bcbf-4e8f-913b-a80b70a44952" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-353ece41-bcbf-4e8f-913b-a80b70a44952" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-0190d2ab-e379-44ad-9be2-229b4c4c07a4" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-0190d2ab-e379-44ad-9be2-229b4c4c07a4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Deleting offline snapshot 0190d2ab-e379-44ad-9be2-229b4c4c07a4 of volume 353ece41-bcbf-4e8f-913b-a80b70a44952 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] snapshot_file for this snap is: volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[016a683a-66c1-4e6c-8121-9784b669c31b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:08 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 Sep 10 20:27:08 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:08 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:08 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-52fddba5-f1f6-4109-a793-38daa031309f" returned: 0 in 0.275s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461" returned: 0 in 0.299s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123c809b-8f45-4ffc-ab0c-82fd682297be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7150ff66e1944e0ba6d101f781b2ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:04Z,use_quota=True,user_id='431f55dd3a86471895cc1e533a611b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Creating volume 123c809b-8f45-4ffc-ab0c-82fd682297be {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:08 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-52fddba5-f1f6-4109-a793-38daa031309f" released by "delete_volume" :: held 0.800s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84291a09-9c81-4e98-8051-47a7d5cce182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151361e2-fabd-4011-a5d6-12181cee2461', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:08 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be 1073741824 Sep 10 20:27:08 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1219d2d6-9158-4fd5-99b4-8e0de4467791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:08 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Volume volume-151361e2-fabd-4011-a5d6-12181cee2461 (151361e2-fabd-4011-a5d6-12181cee2461): created successfully Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1219d2d6-9158-4fd5-99b4-8e0de4467791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (10c5f1e5-928e-4fc0-b7cc-e76e56c5266c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:08 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9e352df1-8c61-4dac-968c-8e4ff17ddfb4 tempest-ProjectMemberTests-995511774 None] Created volume successfully. Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Created reservations ['aeed01ec-420f-49c8-bb8f-d05c6d7a0076', '59cf00de-0873-4157-9889-2b035f38c636', '9a8b406e-c8c9-40a6-8fd2-51200e988f11', '5deeb800-b203-4969-a480-b001849648e2'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:08 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:08 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:08 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4" returned: 0 in 0.440s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-353ece41-bcbf-4e8f-913b-a80b70a44952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ae83d7-cee8-4043-b77e-450b8f7ed150]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:08 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 Sep 10 20:27:08 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:08 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.301s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:08 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Deleted volume successfully. Sep 10 20:27:08 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be 1073741824" returned: 0 in 0.530s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-56fa2589-1864-42d2-b3c3-2c4834954e4e tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-52fddba5-f1f6-4109-a793-38daa031309f-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:08 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be Sep 10 20:27:08 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:08 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952" returned: 0 in 0.416s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:09 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 Sep 10 20:27:09 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:09 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be" returned: 0 in 0.298s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Attempting download of e5368420-41f6-4d3f-8210-94fee6169aa6 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5368420-41f6-4d3f-8210-94fee6169aa6', 'metadata': {}}])) to volume 123c809b-8f45-4ffc-ab0c-82fd682297be. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9e1438-e545-46b6-a424-93bab90ff01d]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5368420-41f6-4d3f-8210-94fee6169aa6_7hh9a8ix {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:09 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5368420-41f6-4d3f-8210-94fee6169aa6_7hh9a8ix Sep 10 20:27:09 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:09 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4" returned: 0 in 0.420s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:09 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4 Sep 10 20:27:09 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Creating offline snapshot f4c3edb6-e915-4f74-a39c-7b0ebabf5733 of volume 151361e2-fabd-4011-a5d6-12181cee2461 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c260383b-d49f-4f5c-aa44-7535023c0be3]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-3282bd6d-bf73-438e-ac64-59a3df0257d3-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-3282bd6d-bf73-438e-ac64-59a3df0257d3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:09 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-quobyte-3282bd6d-bf73-438e-ac64-59a3df0257d3" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5368420-41f6-4d3f-8210-94fee6169aa6_7hh9a8ix" returned: 0 in 0.491s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5368420-41f6-4d3f-8210-94fee6169aa6_7hh9a8ix {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-3282bd6d-bf73-438e-ac64-59a3df0257d3" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d194dfaa-1617-4b90-baa2-1776f5cab344]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:09 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:09 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 Sep 10 20:27:09 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952.0190d2ab-e379-44ad-9be2-229b4c4c07a4" returned: 0 in 0.384s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-0190d2ab-e379-44ad-9be2-229b4c4c07a4" released by "_delete_snapshot" :: held 1.782s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-353ece41-bcbf-4e8f-913b-a80b70a44952" released by "delete_snapshot" :: held 1.809s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:09 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5368420-41f6-4d3f-8210-94fee6169aa6_7hh9a8ix Sep 10 20:27:09 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:09 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 Sep 10 20:27:09 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:09 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Created reservations ['3ae7fd0c-0d60-42f2-adf8-a7f90b19c124', '8fd8316a-c7cd-4158-8802-325044ea88dc', '2f9f7c95-8ac3-4f85-82c4-2124794af0c1', '403ea44f-0f8d-4f81-9b8f-25047fb968ba'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:10 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Delete snapshot completed successfully. Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-84486dd7-9031-4b7f-b328-cdb4708624b7 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-0190d2ab-e379-44ad-9be2-229b4c4c07a4-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:10 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5368420-41f6-4d3f-8210-94fee6169aa6_7hh9a8ix" returned: 1 in 0.364s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5368420-41f6-4d3f-8210-94fee6169aa6_7hh9a8ix' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:27:10 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2dd829-ba3f-4eae-b2f7-267bf8b971cd]: (4, 'raw') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461" returned: 0 in 0.555s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:10 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 1G Sep 10 20:27:10 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-353ece41-bcbf-4e8f-913b-a80b70a44952-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:10 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD Sep 10 20:27:10 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:10 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-353ece41-bcbf-4e8f-913b-a80b70a44952-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3" returned: 0 in 0.514s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:10 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3 Sep 10 20:27:10 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-353ece41-bcbf-4e8f-913b-a80b70a44952" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-353ece41-bcbf-4e8f-913b-a80b70a44952" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b788e52d-3a0f-4a27-8732-46166fc06f77]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:10 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:10 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 Sep 10 20:27:10 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:10 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3282bd6d-bf73-438e-ac64-59a3df0257d3" returned: 0 in 0.348s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-3282bd6d-bf73-438e-ac64-59a3df0257d3" released by "delete_volume" :: held 0.905s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:10 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:10 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD Sep 10 20:27:10 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 1G" returned: 0 in 0.566s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151361e2-fabd-4011-a5d6-12181cee2461 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:10 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151361e2-fabd-4011-a5d6-12181cee2461 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 Sep 10 20:27:10 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Created reservations ['b910d052-7644-4a0e-a6ea-5ec40c05ff1f', 'aad9ef26-4ad4-4cb9-a685-ca42ec3b287b', 'ca3e2e07-2819-4520-87ef-48a2c02c003b', '900276e1-a173-4163-aa0a-0320ab23fe69'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:10 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952" returned: 0 in 0.478s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:10 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:10 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:10 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952 Sep 10 20:27:10 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:10 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD" returned: 1 in 0.437s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] e5368420-41f6-4d3f-8210-94fee6169aa6 was raw, converting to qcow2 {{(pid=88137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 20:27:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:11 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be Sep 10 20:27:11 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:11 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151361e2-fabd-4011-a5d6-12181cee2461 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733" returned: 0 in 0.382s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:11 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 is being set with open permissions: ugo+rw Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:11 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 Sep 10 20:27:11 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:11 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.261s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:11 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Deleted volume successfully. Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1b8fa907-ef55-4e48-95cc-7d8061ac1101 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-3282bd6d-bf73-438e-ac64-59a3df0257d3-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:11 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-353ece41-bcbf-4e8f-913b-a80b70a44952" returned: 0 in 0.313s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-353ece41-bcbf-4e8f-913b-a80b70a44952" released by "delete_volume" :: held 0.867s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Created reservations ['533b9335-d0a9-41b0-a61d-fb3ef8595c21', '7ad748d5-fa6e-48c3-8bea-e339b66abe93', '62141e04-4d8f-496b-971f-34c45d0200b2', 'b88c264f-2d95-404f-89a5-4b6a781410f9'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:11 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733" returned: 0 in 0.343s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:11 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:11 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:11 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.info Sep 10 20:27:11 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:11 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be" returned: 0 in 0.604s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5368420-41f6-4d3f-8210-94fee6169aa6_ihw9oooqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:27:11 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:11 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be 1G Sep 10 20:27:11 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:11 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.298s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:11 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Deleted volume successfully. Sep 10 20:27:11 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.info" returned: 0 in 0.278s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:11 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.info is being set with open permissions: ugo+rw Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-efe6b3b1-8c24-42b9-a1ef-54a511628e87 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-353ece41-bcbf-4e8f-913b-a80b70a44952-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:11 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.info Sep 10 20:27:11 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-93bb1bec-0d9a-4497-9f6f-1970e1966448-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:11 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-93bb1bec-0d9a-4497-9f6f-1970e1966448-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be 1G" returned: 0 in 0.395s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Downloaded image e5368420-41f6-4d3f-8210-94fee6169aa6 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5368420-41f6-4d3f-8210-94fee6169aa6', 'metadata': {}}])) to volume 123c809b-8f45-4ffc-ab0c-82fd682297be successfully. {{(pid=88137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Temporary image e5368420-41f6-4d3f-8210-94fee6169aa6 for user 431f55dd3a86471895cc1e533a611b50 is deleted. {{(pid=88137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 20:27:11 devstack cinder-volume[88137]: DEBUG cinder.volume.volume_utils [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Marking volume 123c809b-8f45-4ffc-ab0c-82fd682297be as bootable. {{(pid=88137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Copying metadata from image e5368420-41f6-4d3f-8210-94fee6169aa6 to 123c809b-8f45-4ffc-ab0c-82fd682297be. {{(pid=88137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Creating volume glance metadata for volume 123c809b-8f45-4ffc-ab0c-82fd682297be backed by image e5368420-41f6-4d3f-8210-94fee6169aa6 with: {'image_id': 'e5368420-41f6-4d3f-8210-94fee6169aa6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ba5c5ecfa859aaf89a25e7a13a3dc3ab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-quobyte-93bb1bec-0d9a-4497-9f6f-1970e1966448" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:12 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.info" returned: 0 in 0.330s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.587s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-93bb1bec-0d9a-4497-9f6f-1970e1966448" acquired by "delete_volume" :: waited 0.044s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe0ee7-b37d-47f2-bef3-00264068c4d5]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-00c0405e-b60f-4661-a23b-5dd9de9449e5 tempest-ProjectMemberTests-995511774 None] Create snapshot completed successfully Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe131fed-20d1-4db7-be1e-8c7ac2633fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-123c809b-8f45-4ffc-ab0c-82fd682297be', 'volume_size': 1, 'image_id': 'e5368420-41f6-4d3f-8210-94fee6169aa6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5368420-41f6-4d3f-8210-94fee6169aa6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba5c5ecfa859aaf89a25e7a13a3dc3ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e7150ff66e1944e0ba6d101f781b2ad9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2be99fa19957ff5f39a5e94685a1cc5b0c1571dfe2b338845ff79ef0d950bb97a9dfcd7be6b4071e6653d452bb7201b7051d672c436340b53b0d2c1806756e89', 'id': 'e5368420-41f6-4d3f-8210-94fee6169aa6', 'created_at': datetime.datetime(2026, 9, 10, 18, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 18, 27, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5368420-41f6-4d3f-8210-94fee6169aa6/file', 'properties': {}}, 'image_service': }' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529135f4-eb8d-4c09-8aec-7e6fa608fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:12 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Volume volume-123c809b-8f45-4ffc-ab0c-82fd682297be (123c809b-8f45-4ffc-ab0c-82fd682297be): created successfully Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529135f4-eb8d-4c09-8aec-7e6fa608fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Flow 'volume_create_manager' (aab20580-c5c7-424a-b154-b50d3a33a04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:12 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b7b7928c-533e-4bce-ae73-3e5b0247dfd3 tempest-VolumeImageDependencyTests-400848655 None] Created volume successfully. Sep 10 20:27:12 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 Sep 10 20:27:12 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:12 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448" returned: 0 in 0.392s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:12 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448 Sep 10 20:27:12 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-f4c3edb6-e915-4f74-a39c-7b0ebabf5733-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Lock "cinder-f4c3edb6-e915-4f74-a39c-7b0ebabf5733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-151361e2-fabd-4011-a5d6-12181cee2461" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-151361e2-fabd-4011-a5d6-12181cee2461" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-f4c3edb6-e915-4f74-a39c-7b0ebabf5733" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-f4c3edb6-e915-4f74-a39c-7b0ebabf5733" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Deleting offline snapshot f4c3edb6-e915-4f74-a39c-7b0ebabf5733 of volume 151361e2-fabd-4011-a5d6-12181cee2461 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] snapshot_file for this snap is: volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acab25a-6dcd-4b25-bb83-898cf2d797d9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:12 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-93bb1bec-0d9a-4497-9f6f-1970e1966448" returned: 0 in 0.296s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-93bb1bec-0d9a-4497-9f6f-1970e1966448" released by "delete_volume" :: held 0.737s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Created reservations ['db8562e0-05a2-4e41-9f9f-3e8af23cb00f', 'efd193fb-89b8-4fd0-8325-ff2cb8310957', '37f301b3-ed49-4314-a164-d77f0e09e502', '960e877d-29cb-4621-bf14-d5a753688989'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:12 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 Sep 10 20:27:12 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:13 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:13 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (39ae5e5f-1dc4-4d5d-9ef0-31b58d472b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd8ca1-da7f-4f96-8e92-385a89bcc503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Acquiring lock "cinder-123c809b-8f45-4ffc-ab0c-82fd682297be-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:13 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd8ca1-da7f-4f96-8e92-385a89bcc503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703021158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad321a03-4e54-40fd-ac7a-a0062aac611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:13Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7557cff6-cfee-4621-b8df-a1b36aafc5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7557cff6-cfee-4621-b8df-a1b36aafc5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f41b90-02d3-4061-a6dd-bf62ecb641fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f41b90-02d3-4061-a6dd-bf62ecb641fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad321a03-4e54-40fd-ac7a-a0062aac611c', 'volume_name': 'volume-ad321a03-4e54-40fd-ac7a-a0062aac611c', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e9f57e-56b8-45b1-acb4-e607c5895454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e9f57e-56b8-45b1-acb4-e607c5895454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4b33a8-abed-46b1-921e-ded20df62f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:13 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Volume ad321a03-4e54-40fd-ac7a-a0062aac611c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad321a03-4e54-40fd-ac7a-a0062aac611c', 'volume_size': 1} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703021158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad321a03-4e54-40fd-ac7a-a0062aac611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:13Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Creating volume ad321a03-4e54-40fd-ac7a-a0062aac611c {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:13 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:13 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-quobyte-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Lock "cinder-123c809b-8f45-4ffc-ab0c-82fd682297be-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733" returned: 0 in 0.668s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151361e2-fabd-4011-a5d6-12181cee2461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:13 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c 1073741824 Sep 10 20:27:13 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.495s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:13 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Deleted volume successfully. Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[69deb515-5559-4a7c-86ef-f474bcc5fbd7]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4" acquired by "delete_volume" :: waited 0.061s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7771e89c-9abc-40d1-965e-0919dd152fbd]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Acquiring lock "cinder-quobyte-123c809b-8f45-4ffc-ab0c-82fd682297be" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-39360037-3781-4354-aca1-003f3c76c9ce tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-93bb1bec-0d9a-4497-9f6f-1970e1966448-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Lock "cinder-quobyte-123c809b-8f45-4ffc-ab0c-82fd682297be" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[110a7c92-9f2f-4307-9a2b-85971dd82034]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:13 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 Sep 10 20:27:13 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:13 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 Sep 10 20:27:13 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:13 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be Sep 10 20:27:13 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:13 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461" returned: 0 in 0.468s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:13 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c 1073741824" returned: 0 in 0.546s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:13 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 Sep 10 20:27:14 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:14 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4" returned: 0 in 0.498s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:14 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be" returned: 0 in 0.443s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:14 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c Sep 10 20:27:14 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:14 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4 Sep 10 20:27:14 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:14 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be Sep 10 20:27:14 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:14 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4" returned: 0 in 0.315s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:14 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:14 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-123c809b-8f45-4ffc-ab0c-82fd682297be" returned: 0 in 0.315s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c" returned: 0 in 0.354s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4" released by "delete_volume" :: held 0.884s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4b33a8-abed-46b1-921e-ded20df62f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad321a03-4e54-40fd-ac7a-a0062aac611c', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888a3da7-a82e-4d01-b7e9-6aa75236ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Lock "cinder-quobyte-123c809b-8f45-4ffc-ab0c-82fd682297be" released by "delete_volume" :: held 0.839s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:14 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733" returned: 0 in 0.475s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:14 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Volume volume-ad321a03-4e54-40fd-ac7a-a0062aac611c (ad321a03-4e54-40fd-ac7a-a0062aac611c): created successfully Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888a3da7-a82e-4d01-b7e9-6aa75236ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:14 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733 Sep 10 20:27:14 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (39ae5e5f-1dc4-4d5d-9ef0-31b58d472b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1c9e07d5-931e-4af0-953e-b81bb56b33ae tempest-ProjectReaderTests-1085143153 None] Created volume successfully. Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Created reservations ['a8e868db-772a-473e-8a2a-04abbcf6e930', '912e3fe7-379e-4bf0-91b4-791ff3a19dcd', 'c4504226-5f25-4c68-bde0-f42890edba95', '8688fc21-faad-403b-ae7f-591e2ee0b457'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Created reservations ['e48f3756-2547-481d-a312-b3a527915b54', '9febbfa2-31bf-420c-89d4-a2f6e744b3c3', '75307fa0-c13e-4064-a188-97da884dfc38', 'ae81bd07-60d4-4a37-a3dc-53d38813d10b'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:14 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:14 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:14 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:14 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:14 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461.f4c3edb6-e915-4f74-a39c-7b0ebabf5733" returned: 0 in 0.313s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-f4c3edb6-e915-4f74-a39c-7b0ebabf5733" released by "_delete_snapshot" :: held 2.054s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-151361e2-fabd-4011-a5d6-12181cee2461" released by "delete_snapshot" :: held 2.082s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Created reservations ['67b3ff8c-31a0-48c5-a7b7-b810c4936632', 'eaa043e6-315a-4fdd-bed5-56d4bce95e22', 'd0f9daf2-c855-41f2-99f1-758e7e2375c5', '6e474c7f-9f2a-4829-9177-4f993fede9a8'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:14 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.285s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Deleted volume successfully. Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8b278815-b7d8-4a71-912c-ccb3e841a46a tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-de4e8cf1-44cf-4e6b-86a5-a4401acce9f4-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:14 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.291s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Deleted volume successfully. Sep 10 20:27:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Delete snapshot completed successfully. Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3c7115c3-123b-4dac-bb92-2bb6329c33e3 tempest-ProjectMemberTests-995511774 None] Lock "cinder-f4c3edb6-e915-4f74-a39c-7b0ebabf5733-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:14 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8fb699ec-8098-4aec-be79-2048e343c18a tempest-VolumeImageDependencyTests-400848655 None] Lock "cinder-123c809b-8f45-4ffc-ab0c-82fd682297be-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-0b80ab0e-c987-456e-af31-598144e11370-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-0b80ab0e-c987-456e-af31-598144e11370-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-quobyte-ece8312e-1c38-4967-bdb4-c23e91838d92" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-ece8312e-1c38-4967-bdb4-c23e91838d92" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-quobyte-0b80ab0e-c987-456e-af31-598144e11370" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-0b80ab0e-c987-456e-af31-598144e11370" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Deleting offline snapshot 0b80ab0e-c987-456e-af31-598144e11370 of volume ece8312e-1c38-4967-bdb4-c23e91838d92 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] snapshot_file for this snap is: volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d72d95-b64b-4665-8ea4-b522a65bfd76]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Creating offline snapshot 3b444db3-d801-41c7-8630-e1d73308071b of volume ad321a03-4e54-40fd-ac7a-a0062aac611c {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f338713b-859e-4549-9c18-f501fbaf4c77]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:15 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 Sep 10 20:27:15 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:15 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c Sep 10 20:27:15 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-151361e2-fabd-4011-a5d6-12181cee2461-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Lock "cinder-151361e2-fabd-4011-a5d6-12181cee2461-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-151361e2-fabd-4011-a5d6-12181cee2461" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-151361e2-fabd-4011-a5d6-12181cee2461" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[40202580-95b1-41e6-8b3a-bd2fb4cd0113]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:16 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:16 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370" returned: 0 in 0.537s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c" returned: 0 in 0.455s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ece8312e-1c38-4967-bdb4-c23e91838d92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b6917f-f7a8-4fad-ad33-794dacf6dfd6]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:16 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b 1G Sep 10 20:27:16 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:16 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 Sep 10 20:27:16 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:16 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 Sep 10 20:27:16 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:16 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461" returned: 0 in 0.465s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:16 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461 Sep 10 20:27:16 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:16 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92" returned: 0 in 0.453s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:16 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 Sep 10 20:27:16 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:16 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b 1G" returned: 0 in 0.536s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad321a03-4e54-40fd-ac7a-a0062aac611c -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:16 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad321a03-4e54-40fd-ac7a-a0062aac611c -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b Sep 10 20:27:16 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:16 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-151361e2-fabd-4011-a5d6-12181cee2461" returned: 0 in 0.349s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:16 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-151361e2-fabd-4011-a5d6-12181cee2461" released by "delete_volume" :: held 0.892s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Created reservations ['9edb6217-ab9f-41ff-a630-a3d87f3a5bac', 'c87275d5-7426-4946-91b9-49deaacab269', '427c4689-8a52-4b1d-9b43-5d4da4e809c4', '465ba865-9b4c-4b2a-a30a-f898fa37e8eb'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:17 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad321a03-4e54-40fd-ac7a-a0062aac611c -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b" returned: 0 in 0.405s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:17 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b is being set with open permissions: ugo+rw Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:17 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370" returned: 0 in 0.484s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:17 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b Sep 10 20:27:17 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:17 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370 Sep 10 20:27:17 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:17 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:17 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:17 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b" returned: 0 in 0.327s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:17 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92.0b80ab0e-c987-456e-af31-598144e11370" returned: 0 in 0.317s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:17 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-0b80ab0e-c987-456e-af31-598144e11370" released by "_delete_snapshot" :: held 1.972s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.333s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-ece8312e-1c38-4967-bdb4-c23e91838d92" released by "delete_snapshot" :: held 2.027s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:17 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.info Sep 10 20:27:17 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Deleted volume successfully. Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0821e8ba-7fc7-41f6-ae56-c505fdf63528 tempest-ProjectMemberTests-995511774 None] Lock "cinder-151361e2-fabd-4011-a5d6-12181cee2461-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Created reservations ['31ebe2cc-b7bc-44c4-a147-b59bc30970d6', '3de8a408-3f40-412a-8b73-95e448a4b749', 'b8cd799c-1f1e-43f8-aac4-def5f6fc7f3a', '8d6faa5f-8791-4765-9f73-7288924ee2bd'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Delete snapshot completed successfully. Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a281fdc3-3a5c-48fc-b785-1e05fa26d518 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-0b80ab0e-c987-456e-af31-598144e11370-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:17 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.info" returned: 0 in 0.306s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:17 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.info is being set with open permissions: ugo+rw Sep 10 20:27:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:17 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.info Sep 10 20:27:17 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:18 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.info" returned: 0 in 0.246s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c9c24e65-653c-4bcc-8c00-3f02a5c81fd9 tempest-ProjectReaderTests-1085143153 None] Create snapshot completed successfully Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-ece8312e-1c38-4967-bdb4-c23e91838d92-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (9817d0fc-a020-4833-9b08-5bc19c042a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b348aaca-40a1-46c1-a7e0-6d822c5b188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-ece8312e-1c38-4967-bdb4-c23e91838d92-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-3b444db3-d801-41c7-8630-e1d73308071b-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b348aaca-40a1-46c1-a7e0-6d822c5b188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441352670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c94f7d4-7d48-46e3-991e-30193d47f6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:19Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9fe004-e875-40b6-87e6-8e2ca661f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9fe004-e875-40b6-87e6-8e2ca661f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73df1864-3a1a-4a2f-958c-41aea8576f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73df1864-3a1a-4a2f-958c-41aea8576f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c94f7d4-7d48-46e3-991e-30193d47f6ab', 'volume_name': 'volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a756c6d3-bf07-4f37-b45a-f94d43037a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a756c6d3-bf07-4f37-b45a-f94d43037a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb94cbd1-da52-4f93-8b1c-8abc1885ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:18 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Volume 5c94f7d4-7d48-46e3-991e-30193d47f6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab', 'volume_size': 1} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441352670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c94f7d4-7d48-46e3-991e-30193d47f6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:19Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Creating volume 5c94f7d4-7d48-46e3-991e-30193d47f6ab {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:18 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:18 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab 1073741824 Sep 10 20:27:18 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Lock "cinder-3b444db3-d801-41c7-8630-e1d73308071b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.112s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-ad321a03-4e54-40fd-ac7a-a0062aac611c" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "cinder-quobyte-ece8312e-1c38-4967-bdb4-c23e91838d92" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-ad321a03-4e54-40fd-ac7a-a0062aac611c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-3b444db3-d801-41c7-8630-e1d73308071b" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-ece8312e-1c38-4967-bdb4-c23e91838d92" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-3b444db3-d801-41c7-8630-e1d73308071b" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Deleting offline snapshot 3b444db3-d801-41c7-8630-e1d73308071b of volume ad321a03-4e54-40fd-ac7a-a0062aac611c {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] snapshot_file for this snap is: volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02469df-b496-42c8-adb0-68a803d722d8]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[071c8af2-4689-4c95-a4ef-6a2a02662673]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:19 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 Sep 10 20:27:19 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:19 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b Sep 10 20:27:19 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:19 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab 1073741824" returned: 0 in 0.527s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:19 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab Sep 10 20:27:19 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:19 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92" returned: 0 in 0.473s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:19 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b" returned: 0 in 0.481s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad321a03-4e54-40fd-ac7a-a0062aac611c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:19 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92 Sep 10 20:27:19 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26cd457-678b-4c1b-be58-fbc9b18264f1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:19 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c Sep 10 20:27:19 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:19 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab" returned: 0 in 0.320s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c71f495f-6cd4-4fac-8d27-0e1d0d6fe25c tempest-ProjectAdminTests-625478201 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1409454345703, 'free_capacity_gb': 1773.1409454345703, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88137) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 20:27:19 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=283,cinder:SELECT=213,cinder:INSERT=73,cinder:DELETE=26 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ece8312e-1c38-4967-bdb4-c23e91838d92" returned: 0 in 0.301s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb94cbd1-da52-4f93-8b1c-8abc1885ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32f14fe-fc06-4c96-8ce1-a20ff469dffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-quobyte-ece8312e-1c38-4967-bdb4-c23e91838d92" released by "delete_volume" :: held 0.890s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Volume volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab (5c94f7d4-7d48-46e3-991e-30193d47f6ab): created successfully Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32f14fe-fc06-4c96-8ce1-a20ff469dffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (9817d0fc-a020-4833-9b08-5bc19c042a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:19 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4c1f3ae3-fb9b-4471-a23a-1438c4260c0c tempest-ProjectMemberTests-995511774 None] Created volume successfully. Sep 10 20:27:19 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Created reservations ['6771f616-ee27-4960-8f77-da4328e03e0b', 'f07b0a0b-b2d2-459d-baf1-94497f0c34fc', '1095b983-2737-45a4-9a8d-37476f9158be', 'a459206b-445b-4a6f-a265-07ee3c3f1fbf'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:20 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:20 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:20 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c" returned: 0 in 0.508s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:20 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b Sep 10 20:27:20 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:20 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.276s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:20 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Deleted volume successfully. Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=215,cinder:UPDATE=291,cinder:DELETE=27,cinder:INSERT=82 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f85d0276-12b4-403b-b17e-48fa75552c04 tempest-CreateVolumesFromSnapshotTest-63604132 None] Lock "cinder-ece8312e-1c38-4967-bdb4-c23e91838d92-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:20 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b" returned: 0 in 0.381s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:20 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b Sep 10 20:27:20 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:20 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:20 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:20 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:20 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.279s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c.3b444db3-d801-41c7-8630-e1d73308071b" returned: 0 in 0.307s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-3b444db3-d801-41c7-8630-e1d73308071b" released by "_delete_snapshot" :: held 1.810s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-ad321a03-4e54-40fd-ac7a-a0062aac611c" released by "delete_snapshot" :: held 1.884s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:20 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Created reservations ['f1b1f536-3000-4d79-b484-bf417c0323da', '49c5d45d-9117-459a-93e0-32a0bc409eb4', '8e5c74f2-a9e9-4a7e-8436-6fac8ff00ad7', 'c91db0c1-d8d8-477e-9d50-1a41cb882c01'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Delete snapshot completed successfully. Sep 10 20:27:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:21 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1deacc83-03e9-4cf6-9b94-ca9d6089fc3c tempest-ProjectReaderTests-1085143153 None] Lock "cinder-3b444db3-d801-41c7-8630-e1d73308071b-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Creating offline snapshot e3e7b634-d2c8-4df1-a2b5-04df462e71a3 of volume 5c94f7d4-7d48-46e3-991e-30193d47f6ab {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:21 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9130561-14e4-46b1-bf60-514b26444b7c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:21 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab Sep 10 20:27:21 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:21 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab" returned: 0 in 0.455s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:21 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 1G Sep 10 20:27:21 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-ad321a03-4e54-40fd-ac7a-a0062aac611c-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-ad321a03-4e54-40fd-ac7a-a0062aac611c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-ad321a03-4e54-40fd-ac7a-a0062aac611c" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-ad321a03-4e54-40fd-ac7a-a0062aac611c" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:22 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 1G" returned: 0 in 0.636s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[141e88eb-c1e2-416d-a0bc-5795264452df]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:22 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 Sep 10 20:27:22 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:22 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c Sep 10 20:27:22 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:22 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3" returned: 0 in 0.441s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:22 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 is being set with open permissions: ugo+rw Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:22 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c" returned: 0 in 0.441s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:22 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 Sep 10 20:27:22 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:22 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c Sep 10 20:27:22 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:23 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ad321a03-4e54-40fd-ac7a-a0062aac611c" returned: 0 in 0.311s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:23 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3" returned: 0 in 0.356s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-ad321a03-4e54-40fd-ac7a-a0062aac611c" released by "delete_volume" :: held 0.847s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:23 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.info Sep 10 20:27:23 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Created reservations ['e8aa084b-0df4-4a45-af4c-ffb7fbff7374', '6333a09c-1739-4cef-a960-613abb0c7caa', '326eb639-48da-475a-b05d-47caa13d09db', '385d0263-50f0-49f0-98ad-3b116d70d2f2'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:23 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:23 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:23 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.info" returned: 0 in 0.341s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:23 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.info is being set with open permissions: ugo+rw Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:23 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.info Sep 10 20:27:23 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:23 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.299s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Deleted volume successfully. Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fc4cc7bd-6d38-4c9d-ac69-7c16c63dd1c8 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-ad321a03-4e54-40fd-ac7a-a0062aac611c-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:23 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.info" returned: 0 in 0.432s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.769s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1ff7f24c-7776-4637-9526-f6ab24daa871 tempest-ProjectMemberTests-995511774 None] Create snapshot completed successfully Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (d5857048-a742-41ef-8e4e-4ffe8f24fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:23 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef5ac92-6933-412a-8197-5f81f45f9352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef5ac92-6933-412a-8197-5f81f45f9352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-216216936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a2c301-4f13-4996-aa09-150fd1be6e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:24Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73ca9dd-b07e-4139-be2a-0b36a90db619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73ca9dd-b07e-4139-be2a-0b36a90db619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5aff24-84dd-4a50-8e77-3a82fbb33f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5aff24-84dd-4a50-8e77-3a82fbb33f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a2c301-4f13-4996-aa09-150fd1be6e38', 'volume_name': 'volume-68a2c301-4f13-4996-aa09-150fd1be6e38', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe760f2a-1462-435a-8267-6eae59014cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe760f2a-1462-435a-8267-6eae59014cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a0aa75-1669-47c9-be6c-51b8c21b82b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:24 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Volume 68a2c301-4f13-4996-aa09-150fd1be6e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a2c301-4f13-4996-aa09-150fd1be6e38', 'volume_size': 1} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-216216936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a2c301-4f13-4996-aa09-150fd1be6e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:24Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Creating volume 68a2c301-4f13-4996-aa09-150fd1be6e38 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:24 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:24 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 1073741824 Sep 10 20:27:24 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-e3e7b634-d2c8-4df1-a2b5-04df462e71a3-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Lock "cinder-e3e7b634-d2c8-4df1-a2b5-04df462e71a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-5c94f7d4-7d48-46e3-991e-30193d47f6ab" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-5c94f7d4-7d48-46e3-991e-30193d47f6ab" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-e3e7b634-d2c8-4df1-a2b5-04df462e71a3" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-e3e7b634-d2c8-4df1-a2b5-04df462e71a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Deleting offline snapshot e3e7b634-d2c8-4df1-a2b5-04df462e71a3 of volume 5c94f7d4-7d48-46e3-991e-30193d47f6ab {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] snapshot_file for this snap is: volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f736030d-ba3c-48f0-af5f-786f629ca49e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:24 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 Sep 10 20:27:24 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:24 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 1073741824" returned: 0 in 0.600s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:24 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 Sep 10 20:27:24 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:24 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3" returned: 0 in 0.515s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e426ee3f-d6c8-4dc9-87c9-48fd72fcd132]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:25 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38" returned: 0 in 0.321s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a0aa75-1669-47c9-be6c-51b8c21b82b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a2c301-4f13-4996-aa09-150fd1be6e38', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b13bcc-cdc1-4164-838e-a1e8c2f7a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:25 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Volume volume-68a2c301-4f13-4996-aa09-150fd1be6e38 (68a2c301-4f13-4996-aa09-150fd1be6e38): created successfully Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b13bcc-cdc1-4164-838e-a1e8c2f7a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (d5857048-a742-41ef-8e4e-4ffe8f24fe32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Flow 'volume_create_manager' (f9ed0081-a444-4ead-9234-a4a9ddf99258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206497ea-9772-4e73-925c-fec7d89b1422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:25 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-56db35fb-3a2d-4ffa-bf59-ca6f78a2484a tempest-ProjectReaderTests-1085143153 None] Created volume successfully. Sep 10 20:27:25 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab Sep 10 20:27:25 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206497ea-9772-4e73-925c-fec7d89b1422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c4bf50-2869-4e6d-bdc0-4616ccb2d50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef1fac9382c401f895f48f7639205c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:25Z,use_quota=True,user_id='bbae279703bc42ea8b8ee5380b82be22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2341c5-7807-4003-8b37-a510eeb027bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2341c5-7807-4003-8b37-a510eeb027bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c93ad27-ec28-4f8d-8ce8-e9f51af8c4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c93ad27-ec28-4f8d-8ce8-e9f51af8c4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c4bf50-2869-4e6d-bdc0-4616ccb2d50b', 'volume_name': 'volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ec638d-7284-4c90-b6ac-c31ddb8121e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ec638d-7284-4c90-b6ac-c31ddb8121e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437186f4-03cf-4418-b26e-f0ff72d21698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:25 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Volume 99c4bf50-2869-4e6d-bdc0-4616ccb2d50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b', 'volume_size': 1} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c4bf50-2869-4e6d-bdc0-4616ccb2d50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef1fac9382c401f895f48f7639205c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:25Z,use_quota=True,user_id='bbae279703bc42ea8b8ee5380b82be22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Creating volume 99c4bf50-2869-4e6d-bdc0-4616ccb2d50b {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:25 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:25 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b 1073741824 Sep 10 20:27:25 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:25 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab" returned: 0 in 0.446s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:25 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 Sep 10 20:27:25 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:25 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b 1073741824" returned: 0 in 0.487s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:25 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b Sep 10 20:27:25 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:25 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3" returned: 0 in 0.395s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:25 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3 Sep 10 20:27:25 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:26 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b" returned: 0 in 0.302s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437186f4-03cf-4418-b26e-f0ff72d21698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26718f37-1afd-4945-8b94-c74aea6c91db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:26 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Volume volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b (99c4bf50-2869-4e6d-bdc0-4616ccb2d50b): created successfully Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26718f37-1afd-4945-8b94-c74aea6c91db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Flow 'volume_create_manager' (f9ed0081-a444-4ead-9234-a4a9ddf99258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:26 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9d8c6ea5-5ede-4918-ae1e-890a607fe166 tempest-CinderUnicodeTest-1004847475 None] Created volume successfully. Sep 10 20:27:26 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab.e3e7b634-d2c8-4df1-a2b5-04df462e71a3" returned: 0 in 0.318s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-e3e7b634-d2c8-4df1-a2b5-04df462e71a3" released by "_delete_snapshot" :: held 1.824s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-5c94f7d4-7d48-46e3-991e-30193d47f6ab" released by "delete_snapshot" :: held 1.854s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Creating offline snapshot e9ce5482-da90-4e46-b54c-2bc7021f69d2 of volume 68a2c301-4f13-4996-aa09-150fd1be6e38 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0114902b-183e-4e93-88a7-374c1120f039]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Created reservations ['61f5e684-dc48-478f-bc0f-1c1a2a71a879', '4029b88d-0c62-4013-8897-42f298fe1412', '9430096f-4e0d-4055-a30e-ea91abe649ab', 'a2af4668-13d9-4e9e-98da-23bd5a7c37bc'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:26 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Delete snapshot completed successfully. Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-fcb52877-3cbc-4806-ac48-778f95c094fe tempest-ProjectMemberTests-995511774 None] Lock "cinder-e3e7b634-d2c8-4df1-a2b5-04df462e71a3-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:26 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 Sep 10 20:27:26 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-5c94f7d4-7d48-46e3-991e-30193d47f6ab-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Lock "cinder-5c94f7d4-7d48-46e3-991e-30193d47f6ab-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-5c94f7d4-7d48-46e3-991e-30193d47f6ab" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-5c94f7d4-7d48-46e3-991e-30193d47f6ab" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfc7fff-6e38-44d1-8f50-74468d74d34c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:26 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38" returned: 0 in 0.491s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:26 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 1G Sep 10 20:27:26 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:26 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab Sep 10 20:27:26 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:27 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab" returned: 0 in 0.403s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:27 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab Sep 10 20:27:27 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:27 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 1G" returned: 0 in 0.519s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a2c301-4f13-4996-aa09-150fd1be6e38 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:27 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a2c301-4f13-4996-aa09-150fd1be6e38 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 Sep 10 20:27:27 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:27 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5c94f7d4-7d48-46e3-991e-30193d47f6ab" returned: 0 in 0.351s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-5c94f7d4-7d48-46e3-991e-30193d47f6ab" released by "delete_volume" :: held 0.822s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Created reservations ['f9ce2a88-296b-4123-b974-98ce319f7889', '46bf1d65-6205-4251-b352-c663270331c9', 'f1f2ab58-6f92-438e-9e21-bfb85569eaaf', '32af7cd9-bb3d-4206-bfc5-d12779a87ff6'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:27 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a2c301-4f13-4996-aa09-150fd1be6e38 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2" returned: 0 in 0.517s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:27 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 is being set with open permissions: ugo+rw Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:27 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 Sep 10 20:27:27 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:27 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:27 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Flow 'volume_create_manager' (cbc41fa5-3f17-4fcf-83de-f9fa2387386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd8ed5d-499f-46d1-94f6-4d89ca37e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd8ed5d-499f-46d1-94f6-4d89ca37e438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-864406282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f53780-26cf-4e5e-94d3-a8c7abc91d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef1fac9382c401f895f48f7639205c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:28Z,use_quota=True,user_id='bbae279703bc42ea8b8ee5380b82be22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07c95fa-2635-4506-906d-d0722b236b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07c95fa-2635-4506-906d-d0722b236b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eaa2310-9d05-4326-ab09-20a62a0003da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eaa2310-9d05-4326-ab09-20a62a0003da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f53780-26cf-4e5e-94d3-a8c7abc91d4b', 'volume_name': 'volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6032940-04fb-4b88-b614-7a826be546a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6032940-04fb-4b88-b614-7a826be546a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f529e449-23f7-4143-8ab2-e3e4b66cab7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Volume f9f53780-26cf-4e5e-94d3-a8c7abc91d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b', 'volume_size': 1} Sep 10 20:27:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:28 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:28 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2" returned: 0 in 0.305s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.322s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Deleted volume successfully. Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-80ff6ef9-1e5a-4ee3-8788-424945823d3f tempest-ProjectMemberTests-995511774 None] Lock "cinder-5c94f7d4-7d48-46e3-991e-30193d47f6ab-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:28 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.info Sep 10 20:27:28 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:28 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.info" returned: 0 in 0.260s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:28 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.info is being set with open permissions: ugo+rw Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:28 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.info Sep 10 20:27:28 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:28 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.info" returned: 0 in 0.263s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.449s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-864406282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f53780-26cf-4e5e-94d3-a8c7abc91d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef1fac9382c401f895f48f7639205c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:28Z,use_quota=True,user_id='bbae279703bc42ea8b8ee5380b82be22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Creating volume f9f53780-26cf-4e5e-94d3-a8c7abc91d4b {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:28 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:28 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b 1073741824 Sep 10 20:27:28 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:28 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-991522c4-889b-449b-a1d2-e9e8c089197a tempest-ProjectReaderTests-1085143153 None] Create snapshot completed successfully Sep 10 20:27:29 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b 1073741824" returned: 0 in 0.497s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:29 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b Sep 10 20:27:29 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (3967cb68-bce4-46f1-9345-0ab05eb8a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f1eca9-b36e-423a-9fb2-e1045c3c0aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f1eca9-b36e-423a-9fb2-e1045c3c0aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093256296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff94a56-10c3-4afb-b1e1-08e016f79ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:29Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eced6d0-7b21-44f5-b4f5-70141b81b688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eced6d0-7b21-44f5-b4f5-70141b81b688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5f3062-ffcb-4b88-b380-d12f0439fd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5f3062-ffcb-4b88-b380-d12f0439fd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff94a56-10c3-4afb-b1e1-08e016f79ec7', 'volume_name': 'volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9968080-2b9c-4716-8213-bb8a5021a103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9968080-2b9c-4716-8213-bb8a5021a103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2861046-dfdb-4093-9063-fea57e6f4d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:29 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Volume 9ff94a56-10c3-4afb-b1e1-08e016f79ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7', 'volume_size': 1} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-e9ce5482-da90-4e46-b54c-2bc7021f69d2-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-e9ce5482-da90-4e46-b54c-2bc7021f69d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-68a2c301-4f13-4996-aa09-150fd1be6e38" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-68a2c301-4f13-4996-aa09-150fd1be6e38" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-e9ce5482-da90-4e46-b54c-2bc7021f69d2" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-e9ce5482-da90-4e46-b54c-2bc7021f69d2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Deleting offline snapshot e9ce5482-da90-4e46-b54c-2bc7021f69d2 of volume 68a2c301-4f13-4996-aa09-150fd1be6e38 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:29 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] snapshot_file for this snap is: volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" returned: 0 in 0.311s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093256296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff94a56-10c3-4afb-b1e1-08e016f79ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:29Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Creating volume 9ff94a56-10c3-4afb-b1e1-08e016f79ec7 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:29 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf2081c-4765-49cc-95af-dc963e56f5b1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:29 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 1073741824 Sep 10 20:27:29 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f529e449-23f7-4143-8ab2-e3e4b66cab7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2dd2a9-bbdc-4061-b727-d66d7e644e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:29 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Volume volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b (f9f53780-26cf-4e5e-94d3-a8c7abc91d4b): created successfully Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2dd2a9-bbdc-4061-b727-d66d7e644e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:29 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Flow 'volume_create_manager' (cbc41fa5-3f17-4fcf-83de-f9fa2387386b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:29 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-804697a8-fffe-4e03-9409-06276a3e3b3e tempest-CinderUnicodeTest-1004847475 None] Created volume successfully. Sep 10 20:27:29 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 Sep 10 20:27:29 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:30 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2" returned: 0 in 0.447s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68a2c301-4f13-4996-aa09-150fd1be6e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1e425b-d422-4e09-9e11-365cf1541787]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:30 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 1073741824" returned: 0 in 0.578s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:30 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 Sep 10 20:27:30 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:30 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 Sep 10 20:27:30 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:30 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" returned: 0 in 0.334s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.200s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2861046-dfdb-4093-9063-fea57e6f4d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb73649b-1058-4c34-8601-b7c3a42da830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Creating offline snapshot cad2a0a1-2570-4031-89b6-b8df1d4a31ce of volume f9f53780-26cf-4e5e-94d3-a8c7abc91d4b {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:30 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38" returned: 0 in 0.513s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba59b38-349c-4044-a8d6-2e1e02054326]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:30 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Volume volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 (9ff94a56-10c3-4afb-b1e1-08e016f79ec7): created successfully Sep 10 20:27:30 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 Sep 10 20:27:30 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb73649b-1058-4c34-8601-b7c3a42da830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (3967cb68-bce4-46f1-9345-0ab05eb8a46b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:30 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c88bce0f-e516-4b53-a4ca-6ea3cdb2cffe tempest-ProjectMemberTests-995511774 None] Created volume successfully. Sep 10 20:27:30 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b Sep 10 20:27:30 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:30 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:30 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" returned: 0 in 0.394s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:31 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:31 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce 1G Sep 10 20:27:31 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2" returned: 0 in 0.453s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:31 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2 Sep 10 20:27:31 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:31 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38.e9ce5482-da90-4e46-b54c-2bc7021f69d2" returned: 0 in 0.359s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-e9ce5482-da90-4e46-b54c-2bc7021f69d2" released by "_delete_snapshot" :: held 1.905s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-68a2c301-4f13-4996-aa09-150fd1be6e38" released by "delete_snapshot" :: held 1.939s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Created reservations ['205941fa-6b2d-4c3f-b83a-2fab8e39b9c3', '310a0edf-fbb9-4ed0-830e-165d879a1407', 'fcb8bfe4-d3d4-4c67-8e11-799f97f2be88', '3ad994c2-0dfa-4193-845c-61a37a107b04'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:31 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce 1G" returned: 0 in 0.522s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:31 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce Sep 10 20:27:31 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:31 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Delete snapshot completed successfully. Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-2204dbf4-6984-4665-a074-dd5b94a05661 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-e9ce5482-da90-4e46-b54c-2bc7021f69d2-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:31 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce" returned: 0 in 0.368s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:31 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce is being set with open permissions: ugo+rw Sep 10 20:27:31 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:31 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce Sep 10 20:27:31 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:32 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce" returned: 0 in 0.275s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:32 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.info Sep 10 20:27:32 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:32 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.info" returned: 0 in 0.279s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:32 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.info is being set with open permissions: ugo+rw Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:32 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.info Sep 10 20:27:32 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-68a2c301-4f13-4996-aa09-150fd1be6e38-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-68a2c301-4f13-4996-aa09-150fd1be6e38-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:32 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.info" returned: 0 in 0.360s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.137s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-68a2c301-4f13-4996-aa09-150fd1be6e38" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Creating offline snapshot cb493ffa-363d-4c4b-9eff-109da8fbc748 of volume 9ff94a56-10c3-4afb-b1e1-08e016f79ec7 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-68a2c301-4f13-4996-aa09-150fd1be6e38" acquired by "delete_volume" :: waited 0.034s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e16d089-781e-4284-a856-d062714fb597]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:32 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-42a996d4-fc3a-403a-8e01-3b0219e4382d tempest-CinderUnicodeTest-1004847475 None] Create snapshot completed successfully Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[026520bf-a1d5-4c24-a766-24432b950ad6]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:33 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 Sep 10 20:27:33 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:33 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 Sep 10 20:27:33 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:33 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" returned: 0 in 0.395s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:33 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38" returned: 0 in 0.409s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:33 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 1G Sep 10 20:27:33 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:33 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38 Sep 10 20:27:33 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "cinder-cad2a0a1-2570-4031-89b6-b8df1d4a31ce-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-cad2a0a1-2570-4031-89b6-b8df1d4a31ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "cinder-quobyte-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-quobyte-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "cinder-quobyte-cad2a0a1-2570-4031-89b6-b8df1d4a31ce" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-quobyte-cad2a0a1-2570-4031-89b6-b8df1d4a31ce" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Deleting offline snapshot cad2a0a1-2570-4031-89b6-b8df1d4a31ce of volume f9f53780-26cf-4e5e-94d3-a8c7abc91d4b {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] snapshot_file for this snap is: volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:33 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-68a2c301-4f13-4996-aa09-150fd1be6e38" returned: 0 in 0.351s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63b4cf0-2b1f-46c5-8689-1b8d140e29e4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-68a2c301-4f13-4996-aa09-150fd1be6e38" released by "delete_volume" :: held 0.840s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Created reservations ['7efb2ee6-7943-4519-a40e-3ae849fe95ae', '3e59d3d6-8e3d-4b37-81a6-277c0ac3c489', '8300ae9b-8edd-4fe0-ad5b-4449e3e5eb76', 'f0f3833a-f506-4101-aa8d-d3d3e90507d7'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:33 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce Sep 10 20:27:33 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:33 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 1G" returned: 0 in 0.592s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:33 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:33 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:33 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 Sep 10 20:27:33 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:34 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.317s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:34 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Deleted volume successfully. Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a63fa807-28dd-4635-92f5-c4c9ddf54560 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-68a2c301-4f13-4996-aa09-150fd1be6e38-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:34 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce" returned: 0 in 0.581s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:34 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eed7f0-dcb4-487c-b296-b6dfa5afb056]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748" returned: 0 in 0.426s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:34 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 is being set with open permissions: ugo+rw Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:34 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 Sep 10 20:27:34 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:34 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b Sep 10 20:27:34 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (23e76da8-015e-44b0-a581-f2829b480959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f82709-6d85-4cf4-b85c-e50d71a1efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f82709-6d85-4cf4-b85c-e50d71a1efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628203401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:35Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e121f071-aef1-4979-9633-427e68b52bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e121f071-aef1-4979-9633-427e68b52bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932ed969-e55c-4893-84f6-bdd79d5e6c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932ed969-e55c-4893-84f6-bdd79d5e6c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0', 'volume_name': 'volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0ba13e-aa16-4298-a93f-28950786e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0ba13e-aa16-4298-a93f-28950786e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:34 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bd7c02-28ba-42f7-bc6d-f3c2768d7815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:34 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Volume 5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0', 'volume_size': 1} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:34 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.info Sep 10 20:27:34 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:34 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" returned: 0 in 0.524s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:34 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce Sep 10 20:27:34 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:35 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.info" returned: 0 in 0.275s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:35 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.info is being set with open permissions: ugo+rw Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:35 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.info Sep 10 20:27:35 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:35 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce" returned: 0 in 0.403s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:35 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce Sep 10 20:27:35 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:35 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.info" returned: 0 in 0.293s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.479s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628203401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:35Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Creating volume 5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:35 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:35 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 1073741824 Sep 10 20:27:35 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-daf54c7a-ef93-49a8-b350-d2d1e3ce5e54 tempest-ProjectMemberTests-995511774 None] Create snapshot completed successfully Sep 10 20:27:35 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b.cad2a0a1-2570-4031-89b6-b8df1d4a31ce" returned: 0 in 0.327s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-quobyte-cad2a0a1-2570-4031-89b6-b8df1d4a31ce" released by "_delete_snapshot" :: held 1.969s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-quobyte-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" released by "delete_snapshot" :: held 2.003s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Created reservations ['0fd645a5-bb7a-4b6c-93e8-42d354f85d2f', '38731b04-67fd-4662-af5f-3cab83cdc827', '0d0ed3a5-86bb-4445-b537-611334f6ce8c', '6351faa4-9ddb-4047-9685-0ba02d37afa7'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Delete snapshot completed successfully. Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-8c55d612-c940-490d-9ccd-40931ebf7cd8 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-cad2a0a1-2570-4031-89b6-b8df1d4a31ce-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:35 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 1073741824" returned: 0 in 0.462s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:35 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 Sep 10 20:27:35 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-cb493ffa-363d-4c4b-9eff-109da8fbc748-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Lock "cinder-cb493ffa-363d-4c4b-9eff-109da8fbc748-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-cb493ffa-363d-4c4b-9eff-109da8fbc748" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-cb493ffa-363d-4c4b-9eff-109da8fbc748" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:35 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Deleting offline snapshot cb493ffa-363d-4c4b-9eff-109da8fbc748 of volume 9ff94a56-10c3-4afb-b1e1-08e016f79ec7 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] snapshot_file for this snap is: volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4b1b7d-33ea-481e-aa3b-726dcba9799e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:36 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 Sep 10 20:27:36 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:36 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" returned: 0 in 0.280s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bd7c02-28ba-42f7-bc6d-f3c2768d7815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2a42f4-7a2a-4f2f-82cd-4832ecce41d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:36 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Volume volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 (5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0): created successfully Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2a42f4-7a2a-4f2f-82cd-4832ecce41d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (23e76da8-015e-44b0-a581-f2829b480959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4a29eb47-5d9e-46cc-b99a-c27030031211 tempest-ProjectReaderTests-1085143153 None] Created volume successfully. Sep 10 20:27:36 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748" returned: 0 in 0.361s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b074f2c5-08f5-4a86-aa91-3843453ece4b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:36 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 Sep 10 20:27:36 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:36 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" returned: 0 in 0.371s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:36 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 Sep 10 20:27:36 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "cinder-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Creating offline snapshot 32c22f6a-c68f-4ea3-9dc4-f46dc00149bf of volume 5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "cinder-quobyte-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7511c11d-832b-4870-8429-e8d52cf0fc3d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-quobyte-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" acquired by "delete_volume" :: waited 0.041s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb601fc-e6e4-4a3d-a7cf-c80402f60188]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:37 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 Sep 10 20:27:37 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:37 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748" returned: 0 in 0.457s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:37 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b Sep 10 20:27:37 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:37 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748 Sep 10 20:27:37 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:37 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" returned: 0 in 0.434s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:37 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf 1G Sep 10 20:27:37 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:37 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7.cb493ffa-363d-4c4b-9eff-109da8fbc748" returned: 0 in 0.297s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:37 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" returned: 0 in 0.466s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-cb493ffa-363d-4c4b-9eff-109da8fbc748" released by "_delete_snapshot" :: held 1.589s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" released by "delete_snapshot" :: held 1.617s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:37 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b Sep 10 20:27:37 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Created reservations ['de76ac0d-05aa-4f53-8c35-c3852f3c251d', '8ce05776-320a-419b-9f09-c41a984730a2', '9328ba67-4f51-460b-8332-6b747c092d26', '2d5cc413-755a-471c-b306-41eb8360f46c'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Delete snapshot completed successfully. Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-55fa8680-478a-4423-a6e4-1f62679ce1a7 tempest-ProjectMemberTests-995511774 None] Lock "cinder-cb493ffa-363d-4c4b-9eff-109da8fbc748-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:37 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" returned: 0 in 0.339s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-quobyte-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b" released by "delete_volume" :: held 0.895s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:37 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf 1G" returned: 0 in 0.502s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:37 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf Sep 10 20:27:37 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:37 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Created reservations ['9bbc607d-c132-47e4-af56-8b92bb77b5ad', 'fd388bcb-0398-46f4-b6a9-d0e040d9cbf4', 'c6a5c7d5-373f-4144-9732-189817422f62', 'd8b97567-222f-42a0-a66b-ed6a0b876d72'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:38 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:38 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "cinder-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-9ff94a56-10c3-4afb-b1e1-08e016f79ec7-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Lock "cinder-9ff94a56-10c3-4afb-b1e1-08e016f79ec7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "cinder-quobyte-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-quobyte-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:38 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf" returned: 0 in 0.378s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:38 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf is being set with open permissions: ugo+rw Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc03dbe-a0ca-4d15-869e-ce292130ae47]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:38 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf Sep 10 20:27:38 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" acquired by "delete_volume" :: waited 0.051s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1927c281-12df-45b8-9fcd-5630a664c44e]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:38 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.355s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Deleted volume successfully. Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a9c9b81d-a670-401d-9bdb-7ba338b0a43a tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-f9f53780-26cf-4e5e-94d3-a8c7abc91d4b-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:38 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b Sep 10 20:27:38 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:38 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 Sep 10 20:27:38 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:38 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf" returned: 0 in 0.276s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:38 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.info Sep 10 20:27:38 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:38 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b" returned: 0 in 0.456s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:38 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:38 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" returned: 0 in 0.426s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:38 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:38 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7 Sep 10 20:27:38 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:38 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.info" returned: 0 in 0.359s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:38 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.info is being set with open permissions: ugo+rw Sep 10 20:27:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:39 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.info Sep 10 20:27:39 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:39 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b" returned: 0 in 0.284s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-quobyte-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b" released by "delete_volume" :: held 0.819s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:39 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" returned: 0 in 0.329s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Created reservations ['126f9b4e-c044-442d-8e81-b9c23af5e4d0', '048a984b-ebc9-40bc-b824-89b9fef583e7', 'ff992ce5-e90b-4cf2-9f89-ee9a3be87f2d', 'd5f5e8d2-eef8-417f-9477-4af721c40947'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-9ff94a56-10c3-4afb-b1e1-08e016f79ec7" released by "delete_volume" :: held 0.831s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Created reservations ['2b814949-72f8-4e3e-b084-24c3b6c84281', 'f01c8bff-08e1-480e-9b4e-dbf0a86c2fe2', '7c5eaf98-51ac-471c-b91a-b9e997cf8d00', 'dab6cbd2-c476-423c-acbc-7fb77ec1be1a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:39 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.info" returned: 0 in 0.397s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:39 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:39 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ea557ad6-cf6e-4a75-8d78-b9e7a8477d2e tempest-ProjectReaderTests-1085143153 None] Create snapshot completed successfully Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:39 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:39 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:39 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.430s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Deleted volume successfully. Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-5ac637ab-be8f-4137-b56d-f480a1179a22 tempest-CinderUnicodeTest-1004847475 None] Lock "cinder-99c4bf50-2869-4e6d-bdc0-4616ccb2d50b-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:39 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.444s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Deleted volume successfully. Sep 10 20:27:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-d815a227-dedb-4017-bdc9-4d2c6f265a1a tempest-ProjectMemberTests-995511774 None] Lock "cinder-9ff94a56-10c3-4afb-b1e1-08e016f79ec7-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-32c22f6a-c68f-4ea3-9dc4-f46dc00149bf-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Lock "cinder-32c22f6a-c68f-4ea3-9dc4-f46dc00149bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-32c22f6a-c68f-4ea3-9dc4-f46dc00149bf" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-32c22f6a-c68f-4ea3-9dc4-f46dc00149bf" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Deleting offline snapshot 32c22f6a-c68f-4ea3-9dc4-f46dc00149bf of volume 5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] snapshot_file for this snap is: volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7f5774-7c43-4514-af4a-a6c6cdfe85cf]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (cd9c5153-bdd7-45b4-ada4-32b67eca6b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d2db48-a0f8-4199-908f-97b210822351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d2db48-a0f8-4199-908f-97b210822351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2067708869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b5ff98-9da1-48a0-8473-8a5a03ba39db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:40Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60fbafb-b456-46b2-8a14-351a342ee4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60fbafb-b456-46b2-8a14-351a342ee4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62606637-44c3-4c37-9f46-b82287ffcb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62606637-44c3-4c37-9f46-b82287ffcb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5b5ff98-9da1-48a0-8473-8a5a03ba39db', 'volume_name': 'volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038befe8-1c34-4c37-b436-3de59caec9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038befe8-1c34-4c37-b436-3de59caec9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32484bd0-9fb0-43f4-935d-9c53c1e9d8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:40 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Volume e5b5ff98-9da1-48a0-8473-8a5a03ba39db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db', 'volume_size': 1} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2067708869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b5ff98-9da1-48a0-8473-8a5a03ba39db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:40Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Creating volume e5b5ff98-9da1-48a0-8473-8a5a03ba39db {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:40 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:40 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf Sep 10 20:27:40 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:40 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db 1073741824 Sep 10 20:27:40 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:40 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf" returned: 0 in 0.418s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f40b00-d03e-4a27-be5d-d705e1bdc6a2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:40 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 Sep 10 20:27:40 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:40 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db 1073741824" returned: 0 in 0.515s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:40 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:41 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db Sep 10 20:27:41 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:41 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" returned: 0 in 0.490s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:41 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf Sep 10 20:27:41 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:41 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" returned: 0 in 0.406s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32484bd0-9fb0-43f4-935d-9c53c1e9d8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5c0642-24be-41fb-8816-fb7d1d716243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:41 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Volume volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db (e5b5ff98-9da1-48a0-8473-8a5a03ba39db): created successfully Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5c0642-24be-41fb-8816-fb7d1d716243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (cd9c5153-bdd7-45b4-ada4-32b67eca6b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:41 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-de3442b6-5cde-4b67-bc98-ee2842957550 tempest-ProjectMemberTests-995511774 None] Created volume successfully. Sep 10 20:27:41 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf" returned: 0 in 0.450s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:41 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf Sep 10 20:27:41 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:41 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0.32c22f6a-c68f-4ea3-9dc4-f46dc00149bf" returned: 0 in 0.283s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:41 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-32c22f6a-c68f-4ea3-9dc4-f46dc00149bf" released by "_delete_snapshot" :: held 1.744s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" released by "delete_snapshot" :: held 1.782s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Created reservations ['c744069c-d398-43b3-a131-e88ef5c0448b', '08a523b3-118d-4953-b274-5d70d7f778a5', 'aeb0188b-8bb4-4dbc-8a09-e2ce195a024b', '2600b732-97db-4334-a035-367933e7f417'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:42 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Delete snapshot completed successfully. Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-013637ce-ffeb-484e-b636-a64cf7cd02aa tempest-ProjectReaderTests-1085143153 None] Lock "cinder-32c22f6a-c68f-4ea3-9dc4-f46dc00149bf-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Lock "cinder-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Creating offline snapshot 55081e7d-1265-4495-bb51-f186787bc8ce of volume e5b5ff98-9da1-48a0-8473-8a5a03ba39db {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[253edf9f-24f7-400d-94b0-a9fff3d88a80]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1247c9-11b4-4151-a708-8a2981d9059d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:42 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:42 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db Sep 10 20:27:42 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:42 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 Sep 10 20:27:42 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:43 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" returned: 0 in 0.473s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:43 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce 1G Sep 10 20:27:43 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:43 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" returned: 0 in 0.459s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:43 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0 Sep 10 20:27:43 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:43 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" returned: 0 in 0.370s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0" released by "delete_volume" :: held 0.928s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Created reservations ['2906073f-af5a-453d-a8c5-fc20095966d2', 'd043d349-1b0d-42a7-8a0b-dfe8c75188e4', 'b2461efe-ae6e-4004-956b-91b5f060ae04', 'a8dfa9c4-0e1b-4973-913f-234af8deca56'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:43 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce 1G" returned: 0 in 0.606s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:43 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce Sep 10 20:27:43 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:43 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:43 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:43 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:44 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce" returned: 0 in 0.341s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:44 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce is being set with open permissions: ugo+rw Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:44 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.271s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Deleted volume successfully. Sep 10 20:27:44 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce Sep 10 20:27:44 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-037ea427-5576-48d8-9aca-2c5c4941c47d tempest-ProjectReaderTests-1085143153 None] Lock "cinder-5ec9f9b5-76d6-40bf-afa0-6cafe7b559f0-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:44 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce" returned: 0 in 0.245s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:44 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.info Sep 10 20:27:44 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:44 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.info" returned: 0 in 0.290s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:44 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.info is being set with open permissions: ugo+rw Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:44 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.info Sep 10 20:27:44 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:44 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.info" returned: 0 in 0.310s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:44 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.399s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:44 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-dc6e71e4-6b16-4985-ac48-7d654dad72d4 tempest-ProjectMemberTests-995511774 None] Create snapshot completed successfully Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (6e45c185-a265-4edc-b943-837208fa29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897040b9-2006-40b4-8f28-a2bff1b1873f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897040b9-2006-40b4-8f28-a2bff1b1873f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-458390715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1773210d-46d5-4793-8f02-9a3f1db67a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:45Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c783cb-7e74-4269-960e-918e50f5b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c783cb-7e74-4269-960e-918e50f5b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4781b930-f6bc-47ef-8de6-63b1b6779f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4781b930-f6bc-47ef-8de6-63b1b6779f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1773210d-46d5-4793-8f02-9a3f1db67a96', 'volume_name': 'volume-1773210d-46d5-4793-8f02-9a3f1db67a96', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bff4e2-9402-44ed-b0d4-9670727e4ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bff4e2-9402-44ed-b0d4-9670727e4ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2754afc1-deeb-4432-9ac5-e5bdd52c6c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:45 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Volume 1773210d-46d5-4793-8f02-9a3f1db67a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1773210d-46d5-4793-8f02-9a3f1db67a96', 'volume_size': 1} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-458390715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1773210d-46d5-4793-8f02-9a3f1db67a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27582a443659476eaaa15c627fa7ffc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:45Z,use_quota=True,user_id='b1387204608d4f01bbf45e7eafd248cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Creating volume 1773210d-46d5-4793-8f02-9a3f1db67a96 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:45 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:45 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 1073741824 Sep 10 20:27:45 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-55081e7d-1265-4495-bb51-f186787bc8ce-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Lock "cinder-55081e7d-1265-4495-bb51-f186787bc8ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-55081e7d-1265-4495-bb51-f186787bc8ce" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-55081e7d-1265-4495-bb51-f186787bc8ce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Deleting offline snapshot 55081e7d-1265-4495-bb51-f186787bc8ce of volume e5b5ff98-9da1-48a0-8473-8a5a03ba39db {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] snapshot_file for this snap is: volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[886ef9f4-39a6-4960-ba97-510fea770800]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:45 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:45 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce Sep 10 20:27:45 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:46 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 1073741824" returned: 0 in 0.558s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:46 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 Sep 10 20:27:46 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:46 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce" returned: 0 in 0.451s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9bb7cc-752a-44d8-97f8-ca8a2af1fd89]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:46 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db Sep 10 20:27:46 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:46 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96" returned: 0 in 0.343s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2754afc1-deeb-4432-9ac5-e5bdd52c6c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1773210d-46d5-4793-8f02-9a3f1db67a96', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea8771d-c546-479f-ae47-09aec4a03743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:46 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Volume volume-1773210d-46d5-4793-8f02-9a3f1db67a96 (1773210d-46d5-4793-8f02-9a3f1db67a96): created successfully Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea8771d-c546-479f-ae47-09aec4a03743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Flow 'volume_create_manager' (6e45c185-a265-4edc-b943-837208fa29b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:46 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2eb8640b-e81b-4eaa-9f14-2e8925fecc0e tempest-ProjectReaderTests-1085143153 None] Created volume successfully. Sep 10 20:27:46 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" returned: 0 in 0.476s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:46 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:46 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce Sep 10 20:27:46 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:47 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce" returned: 0 in 0.421s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:47 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce Sep 10 20:27:47 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:47 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db.55081e7d-1265-4495-bb51-f186787bc8ce" returned: 0 in 0.369s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-55081e7d-1265-4495-bb51-f186787bc8ce" released by "_delete_snapshot" :: held 1.856s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" released by "delete_snapshot" :: held 1.883s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Created reservations ['8acca5e4-7e58-4bbc-ad1f-d556a5727bfd', 'd4ccec4f-bd41-4d34-8da0-a5cec7792320', '717953b3-7bbd-444e-b624-c13d5e4cfae1', '067c6148-cd43-4d9d-b024-081eb20e3b30'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Creating offline snapshot 8cacb8ff-9a14-46e4-8613-cabf960fdee5 of volume 1773210d-46d5-4793-8f02-9a3f1db67a96 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9474e062-bf1c-4043-83e3-0b52f1374c6b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:47 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Delete snapshot completed successfully. Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e11e6277-ded0-4114-af44-ed00a910ffc1 tempest-ProjectMemberTests-995511774 None] Lock "cinder-55081e7d-1265-4495-bb51-f186787bc8ce-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-e5b5ff98-9da1-48a0-8473-8a5a03ba39db-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Lock "cinder-e5b5ff98-9da1-48a0-8473-8a5a03ba39db-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:47 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 Sep 10 20:27:47 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:47 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb383b4c-0473-4913-8d35-ff72d5cce92f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:48 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db Sep 10 20:27:48 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:48 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96" returned: 0 in 0.420s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:48 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 1G Sep 10 20:27:48 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:48 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" returned: 0 in 0.429s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:48 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db Sep 10 20:27:48 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:48 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 1G" returned: 0 in 0.577s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:48 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1773210d-46d5-4793-8f02-9a3f1db67a96 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" returned: 0 in 0.346s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:48 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1773210d-46d5-4793-8f02-9a3f1db67a96 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 Sep 10 20:27:48 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-e5b5ff98-9da1-48a0-8473-8a5a03ba39db" released by "delete_volume" :: held 0.866s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:48 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Created reservations ['fb702c00-6ea3-41d5-b42b-00e4c93ed726', '2722be6f-fb55-4f5c-b770-ed082e530023', 'cbddaebf-57d2-4e75-81dc-5b6df847d0e2', '7cee2ece-6f7f-4556-ad16-0c49e5b2d51c'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:49 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:49 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:49 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1773210d-46d5-4793-8f02-9a3f1db67a96 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5" returned: 0 in 0.501s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:49 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 is being set with open permissions: ugo+rw Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:49 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 Sep 10 20:27:49 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:49 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.457s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:49 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Deleted volume successfully. Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-a8eb7695-f6f1-4d86-8f1b-2b89daeecadb tempest-ProjectMemberTests-995511774 None] Lock "cinder-e5b5ff98-9da1-48a0-8473-8a5a03ba39db-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:49 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5" returned: 0 in 0.407s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:49 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.info Sep 10 20:27:49 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (4dd3856d-ede2-493f-9419-9980ce7bbc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9811eedf-cbf7-4f73-9af0-23d69b136cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9811eedf-cbf7-4f73-9af0-23d69b136cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-989425062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:50Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9826161a-a635-46d6-8bef-8e7363c233b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9826161a-a635-46d6-8bef-8e7363c233b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b0f053-cca3-49ac-895f-4dfc2ad3b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b0f053-cca3-49ac-895f-4dfc2ad3b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953', 'volume_name': 'volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d9c1b2-5df6-4a63-82cd-94791cdd6dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d9c1b2-5df6-4a63-82cd-94791cdd6dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8862f6-0813-4085-8aaf-3ba63b743260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:49 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Volume 2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953', 'volume_size': 1} Sep 10 20:27:49 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:50 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.info" returned: 0 in 0.313s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:50 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.info is being set with open permissions: ugo+rw Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:50 devstack sudo[109238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.info Sep 10 20:27:50 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:50 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.info" returned: 0 in 0.296s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-989425062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:50Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Creating volume 2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:50 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:50 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 1073741824 Sep 10 20:27:50 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:50 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4f30fc69-f1f0-4f17-993e-448af3dd453b tempest-ProjectReaderTests-1085143153 None] Create snapshot completed successfully Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-8cacb8ff-9a14-46e4-8613-cabf960fdee5-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Lock "cinder-8cacb8ff-9a14-46e4-8613-cabf960fdee5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-1773210d-46d5-4793-8f02-9a3f1db67a96" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-1773210d-46d5-4793-8f02-9a3f1db67a96" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:50 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-8cacb8ff-9a14-46e4-8613-cabf960fdee5" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-8cacb8ff-9a14-46e4-8613-cabf960fdee5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Deleting offline snapshot 8cacb8ff-9a14-46e4-8613-cabf960fdee5 of volume 1773210d-46d5-4793-8f02-9a3f1db67a96 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] snapshot_file for this snap is: volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8808cc2d-9850-4656-892c-3aaae472abb5]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:51 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 1073741824" returned: 0 in 0.668s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:51 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 Sep 10 20:27:51 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:51 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 Sep 10 20:27:51 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:51 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" returned: 0 in 0.272s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8862f6-0813-4085-8aaf-3ba63b743260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d937432-dbbd-4ce5-bd8c-5d63b1917b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Volume volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 (2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953): created successfully Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d937432-dbbd-4ce5-bd8c-5d63b1917b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (4dd3856d-ede2-493f-9419-9980ce7bbc92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4794766d-490d-4500-9093-5be538018eab tempest-ProjectMemberTests-995511774 None] Created volume successfully. Sep 10 20:27:51 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5" returned: 0 in 0.469s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1773210d-46d5-4793-8f02-9a3f1db67a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3325d12-992e-450e-ba0c-fba5d126dc06]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:51 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 Sep 10 20:27:51 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:52 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96" returned: 0 in 0.543s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:52 devstack sudo[109261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 Sep 10 20:27:52 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Creating offline snapshot b30fcc38-9d67-460e-892d-47983208f3a9 of volume 2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0393db7-d851-4222-a296-67c054233a55]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:52 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 Sep 10 20:27:52 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:52 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5" returned: 0 in 0.451s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:52 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5 Sep 10 20:27:52 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:52 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" returned: 0 in 0.503s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:52 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 1G Sep 10 20:27:52 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:52 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96.8cacb8ff-9a14-46e4-8613-cabf960fdee5" returned: 0 in 0.312s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-8cacb8ff-9a14-46e4-8613-cabf960fdee5" released by "_delete_snapshot" :: held 1.905s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-1773210d-46d5-4793-8f02-9a3f1db67a96" released by "delete_snapshot" :: held 1.935s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:52 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Created reservations ['613364d4-a0b7-43ef-ba3e-b009f41fd772', 'fa7893b5-cbdb-468e-b158-80300c861aba', '16f1ed87-a271-40cd-8b8e-7fe9465ce74c', '5ea77bce-517b-4272-b331-5c5009e082b2'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Delete snapshot completed successfully. Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-ec51bee0-080b-4476-9c66-899cd0db1c2a tempest-ProjectReaderTests-1085143153 None] Lock "cinder-8cacb8ff-9a14-46e4-8613-cabf960fdee5-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-1773210d-46d5-4793-8f02-9a3f1db67a96-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-1773210d-46d5-4793-8f02-9a3f1db67a96-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "cinder-quobyte-1773210d-46d5-4793-8f02-9a3f1db67a96" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-1773210d-46d5-4793-8f02-9a3f1db67a96" acquired by "delete_volume" :: waited 0.027s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c16b20-a619-4593-8fb7-47e1c35e2c77]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:53 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 1G" returned: 0 in 0.657s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:53 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 Sep 10 20:27:53 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:53 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 Sep 10 20:27:53 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:53 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9" returned: 0 in 0.405s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:53 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 is being set with open permissions: ugo+rw Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:53 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96" returned: 0 in 0.478s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:53 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 Sep 10 20:27:53 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:53 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96 Sep 10 20:27:53 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:54 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9" returned: 0 in 0.319s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:54 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-1773210d-46d5-4793-8f02-9a3f1db67a96" returned: 0 in 0.323s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-quobyte-1773210d-46d5-4793-8f02-9a3f1db67a96" released by "delete_volume" :: held 0.883s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:54 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.info Sep 10 20:27:54 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Created reservations ['1dde2364-44d6-47dc-9e1b-70cb195e7cb3', 'd18acc8e-4131-498b-8baf-6c09a6f44895', 'aafc6840-a1c9-45a2-8775-5d0b8497173b', 'eadb73f9-4c61-46a1-b453-d2aa74ac35e2'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:54 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:54 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:54 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.info" returned: 0 in 0.358s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:54 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.info is being set with open permissions: ugo+rw Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:54 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.info Sep 10 20:27:54 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:54 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.313s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:54 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Deleted volume successfully. Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-11486423-0846-4642-8868-1f5116a8fec6 tempest-ProjectReaderTests-1085143153 None] Lock "cinder-1773210d-46d5-4793-8f02-9a3f1db67a96-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:54 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.info" returned: 0 in 0.333s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:54 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9e6d0e79-756f-4fed-bd9a-57d87b431468 tempest-ProjectMemberTests-995511774 None] Create snapshot completed successfully Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-b30fcc38-9d67-460e-892d-47983208f3a9-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Lock "cinder-b30fcc38-9d67-460e-892d-47983208f3a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-b30fcc38-9d67-460e-892d-47983208f3a9" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-b30fcc38-9d67-460e-892d-47983208f3a9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Deleting offline snapshot b30fcc38-9d67-460e-892d-47983208f3a9 of volume 2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] snapshot_file for this snap is: volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6cf0df-efa2-4aac-8c61-0c03ca366860]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:55 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 Sep 10 20:27:55 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:55 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9" returned: 0 in 0.462s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:27:56 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98cf0bd-eb8d-4309-be29-9a8d26757ab4]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:56 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 Sep 10 20:27:56 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:56 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" returned: 0 in 0.470s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:56 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 Sep 10 20:27:56 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:56 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9" returned: 0 in 0.446s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:56 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9 Sep 10 20:27:56 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:57 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953.b30fcc38-9d67-460e-892d-47983208f3a9" returned: 0 in 0.277s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-b30fcc38-9d67-460e-892d-47983208f3a9" released by "_delete_snapshot" :: held 1.784s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" released by "delete_snapshot" :: held 1.809s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Created reservations ['1f524ad2-b7a2-4310-a7f8-c915f3b08c9e', 'd48699a0-f747-40ef-a79a-7125589e836a', 'c074bf72-fdcc-4d31-82f4-83fe3103feae', '3e81ee2d-4ac2-46d3-bc3d-560d52d633c5'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Delete snapshot completed successfully. Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-1da4266c-9cb1-41d2-84e2-331f907778ee tempest-ProjectMemberTests-995511774 None] Lock "cinder-b30fcc38-9d67-460e-892d-47983208f3a9-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0ba3b2-0fb3-4968-b91c-3bd2df64b037]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:27:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:57 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 Sep 10 20:27:57 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:58 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" returned: 0 in 0.392s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:58 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953 Sep 10 20:27:58 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:58 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" returned: 0 in 0.293s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953" released by "delete_volume" :: held 0.757s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Created reservations ['295d5a0c-fe96-4bd1-b91a-0de1a5710edf', '05e91f72-4dde-4248-b0f8-5ecffb23734e', 'c4cfbe8f-68d0-441e-ad19-c26b64e0babf', '98fef9c0-2525-4d05-b309-0c5d4203dfab'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:58 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:27:58 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:58 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.292s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:27:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Deleted volume successfully. Sep 10 20:27:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f02108df-eea3-407b-a0e2-0ffc09008cb5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-2cd8fc20-10e3-4e3d-84a6-dcb3afe5b953-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (e1555160-c822-4e41-9852-b24a40a568fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10f0b2d-bc81-43a6-9ecb-121bbe6cacf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10f0b2d-bc81-43a6-9ecb-121bbe6cacf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516956918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46429c5c-6594-4949-8bcd-6acf6397d026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:59Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (807f4f23-5ce3-4cad-9404-952f29e70edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (807f4f23-5ce3-4cad-9404-952f29e70edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e1ddac-d45f-4450-9eb8-be32c0d44136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e1ddac-d45f-4450-9eb8-be32c0d44136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46429c5c-6594-4949-8bcd-6acf6397d026', 'volume_name': 'volume-46429c5c-6594-4949-8bcd-6acf6397d026', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02289471-337e-4a2c-a0fe-775940c93e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02289471-337e-4a2c-a0fe-775940c93e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ab237d-7322-4bc7-aa57-75cd210e5b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Volume 46429c5c-6594-4949-8bcd-6acf6397d026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46429c5c-6594-4949-8bcd-6acf6397d026', 'volume_size': 1} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516956918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46429c5c-6594-4949-8bcd-6acf6397d026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:27:59Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Creating volume 46429c5c-6594-4949-8bcd-6acf6397d026 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:27:59 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:27:59 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 1073741824 Sep 10 20:27:59 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Flow 'volume_create_manager' (a5fbc20d-d185-40f0-8b17-97452908a146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df8cf94-d80b-4fd5-9ce1-8e08b86cda85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df8cf94-d80b-4fd5-9ce1-8e08b86cda85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667555046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7200ca49-2a5b-4ea6-9413-7e2584931d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3c746e0e2b4c59a59e63d30f4979c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:00Z,use_quota=True,user_id='f42815669ba44e81959c4ea8ed4e7b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ac0498-4b90-4b88-927d-902ab4a11515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ac0498-4b90-4b88-927d-902ab4a11515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ea8c24-6eaf-4b83-a3d5-ed961104c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ea8c24-6eaf-4b83-a3d5-ed961104c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7200ca49-2a5b-4ea6-9413-7e2584931d49', 'volume_name': 'volume-7200ca49-2a5b-4ea6-9413-7e2584931d49', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec889e14-d510-470a-a761-9fe187411d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec889e14-d510-470a-a761-9fe187411d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41cbb7e-8ac4-4814-9ba1-bc3be5ef1762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:27:59 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Volume 7200ca49-2a5b-4ea6-9413-7e2584931d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7200ca49-2a5b-4ea6-9413-7e2584931d49', 'volume_size': 1} Sep 10 20:27:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:00 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 1073741824" returned: 0 in 0.465s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:00 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 Sep 10 20:28:00 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:00 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026" returned: 0 in 0.269s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667555046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7200ca49-2a5b-4ea6-9413-7e2584931d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3c746e0e2b4c59a59e63d30f4979c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:00Z,use_quota=True,user_id='f42815669ba44e81959c4ea8ed4e7b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Creating volume 7200ca49-2a5b-4ea6-9413-7e2584931d49 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:00 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ab237d-7322-4bc7-aa57-75cd210e5b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46429c5c-6594-4949-8bcd-6acf6397d026', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:00 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 1073741824 Sep 10 20:28:00 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734dbe14-b390-45b6-b9c3-4eeeb6d1237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:00 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Volume volume-46429c5c-6594-4949-8bcd-6acf6397d026 (46429c5c-6594-4949-8bcd-6acf6397d026): created successfully Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734dbe14-b390-45b6-b9c3-4eeeb6d1237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (e1555160-c822-4e41-9852-b24a40a568fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:00 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-79f0ed91-4d6c-459a-bd6b-cc62b38bcb69 tempest-ProjectMemberTests-995511774 None] Created volume successfully. Sep 10 20:28:00 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 1073741824" returned: 0 in 0.449s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:00 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 Sep 10 20:28:00 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:01 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49" returned: 0 in 0.248s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41cbb7e-8ac4-4814-9ba1-bc3be5ef1762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7200ca49-2a5b-4ea6-9413-7e2584931d49', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5474cfd9-4c87-4033-8c52-91af507da7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:01 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Volume volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 (7200ca49-2a5b-4ea6-9413-7e2584931d49): created successfully Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5474cfd9-4c87-4033-8c52-91af507da7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Flow 'volume_create_manager' (a5fbc20d-d185-40f0-8b17-97452908a146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-b31c32a9-e813-4e0d-93a8-eabbe9591cad tempest-ProjectReaderTests-475293904 None] Created volume successfully. Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Creating offline snapshot a1832ac8-3f93-4f2e-95ce-714dfc7673f9 of volume 46429c5c-6594-4949-8bcd-6acf6397d026 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7843d8c5-b905-4aba-aebf-027cb83483d1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Acquiring lock "cinder-7200ca49-2a5b-4ea6-9413-7e2584931d49-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Lock "cinder-7200ca49-2a5b-4ea6-9413-7e2584931d49-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:01 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 Sep 10 20:28:01 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Acquiring lock "cinder-quobyte-7200ca49-2a5b-4ea6-9413-7e2584931d49" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Lock "cinder-quobyte-7200ca49-2a5b-4ea6-9413-7e2584931d49" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68f6760-2213-4cc8-a88a-146b9285941a]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:02 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 Sep 10 20:28:02 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:02 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026" returned: 0 in 0.438s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:02 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 1G Sep 10 20:28:02 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:02 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49" returned: 0 in 0.444s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:02 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49 Sep 10 20:28:02 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:02 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 1G" returned: 0 in 0.435s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46429c5c-6594-4949-8bcd-6acf6397d026 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:02 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46429c5c-6594-4949-8bcd-6acf6397d026 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 Sep 10 20:28:02 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:02 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:02 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-7200ca49-2a5b-4ea6-9413-7e2584931d49" returned: 0 in 0.352s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:02 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Lock "cinder-quobyte-7200ca49-2a5b-4ea6-9413-7e2584931d49" released by "delete_volume" :: held 0.857s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:02 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Created reservations ['a06acc62-9b3d-49ab-912b-615a7b1f3ecc', '605355d7-f5ef-45cb-864e-f93f7dafbc3e', '9bd562c0-793b-4f88-8f6c-b1b7cc4f7c16', '95c219e8-a3c8-4a68-8aac-0bbef9316b27'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:03 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:03 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:03 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46429c5c-6594-4949-8bcd-6acf6397d026 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9" returned: 0 in 0.511s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:03 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 is being set with open permissions: ugo+rw Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:03 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 Sep 10 20:28:03 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:03 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.281s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:03 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Deleted volume successfully. Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-707031a8-df2c-4632-b05d-5af6cb31543d tempest-ProjectReaderTests-475293904 None] Lock "cinder-7200ca49-2a5b-4ea6-9413-7e2584931d49-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:03 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9" returned: 0 in 0.291s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:03 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.info Sep 10 20:28:03 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:03 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.info" returned: 0 in 0.279s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:03 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.info is being set with open permissions: ugo+rw Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:03 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.info Sep 10 20:28:03 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:03 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:03 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.info" returned: 0 in 0.263s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:04 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f36b8850-fd46-4ded-b659-28d7b17b1943 tempest-ProjectMemberTests-995511774 None] Create snapshot completed successfully Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Flow 'volume_create_manager' (2a62aa50-1adc-4d56-928f-b934333f205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398f8aa7-901f-4292-9c56-40741cf9f6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398f8aa7-901f-4292-9c56-40741cf9f6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670619486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3c746e0e2b4c59a59e63d30f4979c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:05Z,use_quota=True,user_id='f42815669ba44e81959c4ea8ed4e7b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7603b124-cc33-459c-b390-10ffd040ebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7603b124-cc33-459c-b390-10ffd040ebd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34710f1-a91c-476d-9943-eeeee11ffdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34710f1-a91c-476d-9943-eeeee11ffdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186', 'volume_name': 'volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5f5899-aa2b-43c5-b053-9a1d49189925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5f5899-aa2b-43c5-b053-9a1d49189925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7aab3e-afb9-4bb9-9878-e2c7679bb67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:04 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Volume 3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186', 'volume_size': 1} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670619486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3c746e0e2b4c59a59e63d30f4979c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:05Z,use_quota=True,user_id='f42815669ba44e81959c4ea8ed4e7b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Creating volume 3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:04 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:04 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 1073741824 Sep 10 20:28:04 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-a1832ac8-3f93-4f2e-95ce-714dfc7673f9-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Lock "cinder-a1832ac8-3f93-4f2e-95ce-714dfc7673f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-46429c5c-6594-4949-8bcd-6acf6397d026" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-46429c5c-6594-4949-8bcd-6acf6397d026" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-a1832ac8-3f93-4f2e-95ce-714dfc7673f9" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-a1832ac8-3f93-4f2e-95ce-714dfc7673f9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Deleting offline snapshot a1832ac8-3f93-4f2e-95ce-714dfc7673f9 of volume 46429c5c-6594-4949-8bcd-6acf6397d026 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] snapshot_file for this snap is: volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefd3210-861b-42a1-a906-53c41ddb646d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:04 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:05 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 Sep 10 20:28:05 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:05 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 1073741824" returned: 0 in 0.597s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:05 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 Sep 10 20:28:05 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:05 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9" returned: 0 in 0.538s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46429c5c-6594-4949-8bcd-6acf6397d026(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[778135c1-db6c-422c-bd3c-4ea62a009023]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:05 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186" returned: 0 in 0.363s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:05 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 Sep 10 20:28:05 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7aab3e-afb9-4bb9-9878-e2c7679bb67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954efe7a-7114-4edf-a35f-06cb9d27afaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:05 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Volume volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 (3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186): created successfully Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954efe7a-7114-4edf-a35f-06cb9d27afaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:05 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Flow 'volume_create_manager' (2a62aa50-1adc-4d56-928f-b934333f205c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:05 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2efd1a87-9b86-47b1-b08f-82fafcbcc520 tempest-ProjectReaderTests-475293904 None] Created volume successfully. Sep 10 20:28:06 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026" returned: 0 in 0.454s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:06 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 Sep 10 20:28:06 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:06 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9" returned: 0 in 0.375s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:06 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9 Sep 10 20:28:06 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:06 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026.a1832ac8-3f93-4f2e-95ce-714dfc7673f9" returned: 0 in 0.262s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-a1832ac8-3f93-4f2e-95ce-714dfc7673f9" released by "_delete_snapshot" :: held 1.765s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-46429c5c-6594-4949-8bcd-6acf6397d026" released by "delete_snapshot" :: held 1.795s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Acquiring lock "cinder-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Created reservations ['ff5a6e03-8484-43b6-9ee2-48bbdb4db4fb', 'bb9ac375-235f-41f6-bedf-70a72d80b843', '89369155-d500-43f6-b874-743deef2c997', 'c7af1b37-6762-4597-a256-4fbf1866bc9a'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Lock "cinder-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Acquiring lock "cinder-quobyte-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:06 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Delete snapshot completed successfully. Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-567c762b-7bec-4824-8d04-0c83cf3034c4 tempest-ProjectMemberTests-995511774 None] Lock "cinder-a1832ac8-3f93-4f2e-95ce-714dfc7673f9-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Lock "cinder-quobyte-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186" acquired by "delete_volume" :: waited 0.031s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c637ba79-b357-4ce5-b8f2-120989741deb]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:06 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:07 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 Sep 10 20:28:07 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-46429c5c-6594-4949-8bcd-6acf6397d026-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Lock "cinder-46429c5c-6594-4949-8bcd-6acf6397d026-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-46429c5c-6594-4949-8bcd-6acf6397d026" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-46429c5c-6594-4949-8bcd-6acf6397d026" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7f38c1-25d8-4450-80a4-15525fde5dd1]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:07 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 Sep 10 20:28:07 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:07 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186" returned: 0 in 0.450s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:07 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186 Sep 10 20:28:07 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:07 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026" returned: 0 in 0.471s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:07 devstack sudo[109440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026 Sep 10 20:28:07 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:07 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186" returned: 0 in 0.331s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Lock "cinder-quobyte-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186" released by "delete_volume" :: held 0.832s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Created reservations ['ab234601-cc3c-4eb9-862d-a075d90fdc83', 'ca42931b-bd57-42e1-8d60-6a48cf4040d5', '360959a8-8f3d-466e-a6d6-5712b902774d', '99092a8c-9121-45fd-a8ec-fc8fd3764c67'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:07 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:07 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:07 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:08 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-46429c5c-6594-4949-8bcd-6acf6397d026" returned: 0 in 0.367s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-46429c5c-6594-4949-8bcd-6acf6397d026" released by "delete_volume" :: held 0.929s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Created reservations ['f5cec439-6a11-46e1-b5cf-9de60496ab4d', 'f5ef8c57-b11f-4534-999b-285ec855264c', '6e4d1db0-4c9f-42ab-acc0-a407a6ea4f80', 'fa88af91-b75f-4206-99bf-d642ca55fc71'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:08 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.403s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:08 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Deleted volume successfully. Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-0b894f8e-998a-434e-8b8f-9437e6b25239 tempest-ProjectReaderTests-475293904 None] Lock "cinder-3bd52a63-c3e3-4c9e-9ccb-a7d0643f4186-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:08 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:08 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:08 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.365s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:08 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Deleted volume successfully. Sep 10 20:28:08 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-3165102f-eb08-4286-8e46-0fdc4f3d25f2 tempest-ProjectMemberTests-995511774 None] Lock "cinder-46429c5c-6594-4949-8bcd-6acf6397d026-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:09 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (4c48f5ec-8ae7-4301-8b28-61c2a0955b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438ae3ed-8930-420d-a69d-f35e95963827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438ae3ed-8930-420d-a69d-f35e95963827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178010981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd112ee-6d4c-4315-924b-50f7aa035281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:10Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c73ba7-762f-4537-a276-1cc5d824b44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c73ba7-762f-4537-a276-1cc5d824b44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbfd7f1-f1c8-4f3b-9c86-f6a3e2222f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:09 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbfd7f1-f1c8-4f3b-9c86-f6a3e2222f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd112ee-6d4c-4315-924b-50f7aa035281', 'volume_name': 'volume-edd112ee-6d4c-4315-924b-50f7aa035281', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4569196-1404-433a-8892-70ac7eb1ebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4569196-1404-433a-8892-70ac7eb1ebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a725e9be-822b-4b9f-96d3-56309e61524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:10 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Volume edd112ee-6d4c-4315-924b-50f7aa035281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd112ee-6d4c-4315-924b-50f7aa035281', 'volume_size': 1} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178010981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd112ee-6d4c-4315-924b-50f7aa035281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:10Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Creating volume edd112ee-6d4c-4315-924b-50f7aa035281 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:10 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:10 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 1073741824 Sep 10 20:28:10 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:10 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 1073741824" returned: 0 in 0.536s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:10 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 Sep 10 20:28:10 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:10 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281" returned: 0 in 0.328s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a725e9be-822b-4b9f-96d3-56309e61524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd112ee-6d4c-4315-924b-50f7aa035281', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bea60e-b4fe-4590-9af0-3660d5ee6957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:10 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Volume volume-edd112ee-6d4c-4315-924b-50f7aa035281 (edd112ee-6d4c-4315-924b-50f7aa035281): created successfully Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bea60e-b4fe-4590-9af0-3660d5ee6957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:10 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (4c48f5ec-8ae7-4301-8b28-61c2a0955b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:11 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-888a2eba-4295-44a2-9673-093c2279a625 tempest-ProjectMemberTests-995511774 None] Created volume successfully. Sep 10 20:28:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:12 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Creating offline snapshot ba8a70d2-7403-415f-8e78-4aeb7d8a8548 of volume edd112ee-6d4c-4315-924b-50f7aa035281 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:28:12 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7200150-4cf0-47f8-8b80-a5fee129b91a]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:12 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 Sep 10 20:28:12 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:12 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281" returned: 0 in 0.373s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:12 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:12 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 1G Sep 10 20:28:12 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:13 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 1G" returned: 0 in 0.465s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd112ee-6d4c-4315-924b-50f7aa035281 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:13 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd112ee-6d4c-4315-924b-50f7aa035281 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 Sep 10 20:28:13 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:13 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd112ee-6d4c-4315-924b-50f7aa035281 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548" returned: 0 in 0.288s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:13 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 is being set with open permissions: ugo+rw Sep 10 20:28:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:13 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 Sep 10 20:28:13 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:13 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548" returned: 0 in 0.267s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:13 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.info Sep 10 20:28:13 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:13 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.info" returned: 0 in 0.251s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:13 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.info is being set with open permissions: ugo+rw Sep 10 20:28:13 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:13 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.info Sep 10 20:28:13 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:14 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.info" returned: 0 in 0.338s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:14 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:14 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-2726730d-28bc-4354-990b-ddac63435864 tempest-ProjectMemberTests-995511774 None] Create snapshot completed successfully Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-ba8a70d2-7403-415f-8e78-4aeb7d8a8548-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Lock "cinder-ba8a70d2-7403-415f-8e78-4aeb7d8a8548-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-edd112ee-6d4c-4315-924b-50f7aa035281" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-edd112ee-6d4c-4315-924b-50f7aa035281" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-ba8a70d2-7403-415f-8e78-4aeb7d8a8548" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-ba8a70d2-7403-415f-8e78-4aeb7d8a8548" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Deleting offline snapshot ba8a70d2-7403-415f-8e78-4aeb7d8a8548 of volume edd112ee-6d4c-4315-924b-50f7aa035281 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] snapshot_file for this snap is: volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[165ed041-4203-4e70-8c49-4c64e36b3e97]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:15 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 Sep 10 20:28:15 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:15 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548" returned: 0 in 0.386s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd112ee-6d4c-4315-924b-50f7aa035281(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[363c2bb2-1490-40d0-bfd6-9c2974740d0b]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:15 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:16 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 Sep 10 20:28:16 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:16 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281" returned: 0 in 0.419s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:16 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 Sep 10 20:28:16 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:16 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548" returned: 0 in 0.379s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:16 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:16 devstack sudo[109503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548 Sep 10 20:28:16 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:17 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281.ba8a70d2-7403-415f-8e78-4aeb7d8a8548" returned: 0 in 0.288s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-ba8a70d2-7403-415f-8e78-4aeb7d8a8548" released by "_delete_snapshot" :: held 1.587s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-edd112ee-6d4c-4315-924b-50f7aa035281" released by "delete_snapshot" :: held 1.616s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Created reservations ['9e626b79-8436-4f30-b19d-a04b28ec5f2b', '82362682-7da0-4cbb-90bc-375af5c0b8cb', '26b7976a-8799-45c5-8159-86f97c201d07', 'db224c25-f62f-47cf-8312-453e34f3d53e'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:17 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Delete snapshot completed successfully. Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-f9e02db8-ffff-4b02-a3b4-33512fb256a9 tempest-ProjectMemberTests-995511774 None] Lock "cinder-ba8a70d2-7403-415f-8e78-4aeb7d8a8548-delete_snapshot" released by "delete_snapshot" :: held 1.773s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-edd112ee-6d4c-4315-924b-50f7aa035281-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Lock "cinder-edd112ee-6d4c-4315-924b-50f7aa035281-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-edd112ee-6d4c-4315-924b-50f7aa035281" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-edd112ee-6d4c-4315-924b-50f7aa035281" acquired by "delete_volume" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9e4fec-b72e-42f1-8f36-b7fffe6b996d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:17 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:17 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 Sep 10 20:28:17 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:18 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281" returned: 0 in 0.391s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:18 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281 Sep 10 20:28:18 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:18 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-edd112ee-6d4c-4315-924b-50f7aa035281" returned: 0 in 0.281s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-edd112ee-6d4c-4315-924b-50f7aa035281" released by "delete_volume" :: held 0.747s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Created reservations ['a72d49ec-f127-4c1e-aefa-fca48c422238', '825ba138-8579-4d99-aef5-5ce801ef5091', '2307a99e-366b-4adb-9a71-b1b0b8e172b5', '580762e4-1d1e-4b93-9552-3a71d44774bc'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:18 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:18 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:18 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.321s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:18 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Deleted volume successfully. Sep 10 20:28:18 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-057f54b5-b9f3-4b74-8741-0ad6a37a4290 tempest-ProjectMemberTests-995511774 None] Lock "cinder-edd112ee-6d4c-4315-924b-50f7aa035281-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (64e85bee-1d68-4b3f-866e-1c1ae0cbbb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfea543-9c98-4dc6-9e95-7dbde5f11c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfea543-9c98-4dc6-9e95-7dbde5f11c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278147319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78f915b-37c7-4b09-acc4-7f42449ec106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:19Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a841ef03-b996-40fa-b808-a7801892180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a841ef03-b996-40fa-b808-a7801892180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8a2c3c-283b-47f8-af6d-101742273f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8a2c3c-283b-47f8-af6d-101742273f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78f915b-37c7-4b09-acc4-7f42449ec106', 'volume_name': 'volume-d78f915b-37c7-4b09-acc4-7f42449ec106', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7895dec6-0e87-4149-9110-de894918c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7895dec6-0e87-4149-9110-de894918c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e68a767-bd91-4611-bd92-38a1de2f59d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:19 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Volume d78f915b-37c7-4b09-acc4-7f42449ec106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78f915b-37c7-4b09-acc4-7f42449ec106', 'volume_size': 1} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278147319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78f915b-37c7-4b09-acc4-7f42449ec106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:19Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Creating volume d78f915b-37c7-4b09-acc4-7f42449ec106 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:19 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:19 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 1073741824 Sep 10 20:28:19 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:19 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 1073741824" returned: 0 in 0.469s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:INSERT=61,cinder:UPDATE=234,cinder:SELECT=179,cinder:DELETE=19 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:28:19 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:19 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 Sep 10 20:28:19 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Flow 'volume_create_manager' (3cf5fbac-1a9d-49f8-a5e8-984acc845b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa850b2-004a-4410-8e03-1773457851f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa850b2-004a-4410-8e03-1773457851f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1257283034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc6ed14-8b79-4954-b65d-516c7db502be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68aae88145e49a3af2ad5baa9953b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:20Z,use_quota=True,user_id='9f1c749c574c412da90f852d3fb2fbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6519e451-c30c-4454-bdf9-bb17771d98b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6519e451-c30c-4454-bdf9-bb17771d98b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f511743-84d0-46a4-b53e-fde4d0301c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f511743-84d0-46a4-b53e-fde4d0301c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc6ed14-8b79-4954-b65d-516c7db502be', 'volume_name': 'volume-9fc6ed14-8b79-4954-b65d-516c7db502be', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45785faa-511d-4990-9329-7057cf012249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45785faa-511d-4990-9329-7057cf012249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b726a3-1bde-4ab4-bc06-d623e06b6509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:20 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Volume 9fc6ed14-8b79-4954-b65d-516c7db502be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc6ed14-8b79-4954-b65d-516c7db502be', 'volume_size': 1} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:20 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106" returned: 0 in 0.244s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1257283034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc6ed14-8b79-4954-b65d-516c7db502be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68aae88145e49a3af2ad5baa9953b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:20Z,use_quota=True,user_id='9f1c749c574c412da90f852d3fb2fbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Creating volume 9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:20 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e68a767-bd91-4611-bd92-38a1de2f59d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78f915b-37c7-4b09-acc4-7f42449ec106', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1848135a-c709-4575-b3ed-5e0e4cce3a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:20 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be 1073741824 Sep 10 20:28:20 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:20 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Volume volume-d78f915b-37c7-4b09-acc4-7f42449ec106 (d78f915b-37c7-4b09-acc4-7f42449ec106): created successfully Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1848135a-c709-4575-b3ed-5e0e4cce3a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (64e85bee-1d68-4b3f-866e-1c1ae0cbbb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:20 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4496dac1-bb33-4998-b751-54948c1e6ea4 tempest-ProjectMemberTests-995511774 None] Created volume successfully. Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:20 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:20 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:20 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be 1073741824" returned: 0 in 0.473s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=171,cinder:INSERT=64,cinder:UPDATE=228,cinder:DELETE=17 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:20 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be Sep 10 20:28:20 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:20 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.267s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 20:28:20 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be" returned: 0 in 0.252s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b726a3-1bde-4ab4-bc06-d623e06b6509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc6ed14-8b79-4954-b65d-516c7db502be', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775db2b5-dd5b-4b20-aabb-23ece52c62db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:21 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Volume volume-9fc6ed14-8b79-4954-b65d-516c7db502be (9fc6ed14-8b79-4954-b65d-516c7db502be): created successfully Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775db2b5-dd5b-4b20-aabb-23ece52c62db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Flow 'volume_create_manager' (3cf5fbac-1a9d-49f8-a5e8-984acc845b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:21 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-7a6cc082-aece-40b9-834f-8b51c5ebcbea tempest-SnapshotDependencyTests-126443036 None] Created volume successfully. Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Creating offline snapshot d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 of volume d78f915b-37c7-4b09-acc4-7f42449ec106 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3492bc55-52da-4c55-bb7c-8a111dc70fee]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:21 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 Sep 10 20:28:21 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:21 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106" returned: 0 in 0.361s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:21 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:22 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 1G Sep 10 20:28:22 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:22 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 1G" returned: 0 in 0.415s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78f915b-37c7-4b09-acc4-7f42449ec106 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:22 devstack sudo[109549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78f915b-37c7-4b09-acc4-7f42449ec106 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 Sep 10 20:28:22 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:22 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78f915b-37c7-4b09-acc4-7f42449ec106 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94" returned: 0 in 0.275s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:22 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 is being set with open permissions: ugo+rw Sep 10 20:28:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:22 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 Sep 10 20:28:22 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:22 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94" returned: 0 in 0.246s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:22 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:22 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.info Sep 10 20:28:22 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:23 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.info" returned: 0 in 0.248s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:23 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.info is being set with open permissions: ugo+rw Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:23 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.info Sep 10 20:28:23 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:23 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.info" returned: 0 in 0.247s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.108s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Creating offline snapshot 9ea277bb-ba8b-4034-bdac-a796cafeb4f7 of volume 9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6902d3d-83f5-46d8-a637-c399f79f0505]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:23 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-37ba59d7-a669-4310-86f1-7f0cf1de2c3a tempest-ProjectMemberTests-995511774 None] Create snapshot completed successfully Sep 10 20:28:23 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be Sep 10 20:28:23 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-d78f915b-37c7-4b09-acc4-7f42449ec106" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-d78f915b-37c7-4b09-acc4-7f42449ec106" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Deleting offline snapshot d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 of volume d78f915b-37c7-4b09-acc4-7f42449ec106 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] snapshot_file for this snap is: volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16577bd-8f46-4aba-940c-bb0267acd81c]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:23 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:23 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:23 devstack sudo[109569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 1G Sep 10 20:28:23 devstack sudo[109569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:23 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 Sep 10 20:28:23 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:24 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94" returned: 0 in 0.360s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78f915b-37c7-4b09-acc4-7f42449ec106(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e710f5-40c9-4de5-ba36-558177bf1db9]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:24 devstack sudo[109569]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 1G" returned: 0 in 0.427s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc6ed14-8b79-4954-b65d-516c7db502be -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:24 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc6ed14-8b79-4954-b65d-516c7db502be -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 Sep 10 20:28:24 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:24 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 Sep 10 20:28:24 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:24 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106" returned: 0 in 0.375s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:24 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc6ed14-8b79-4954-b65d-516c7db502be -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7" returned: 0 in 0.304s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:24 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 is being set with open permissions: ugo+rw Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:24 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 Sep 10 20:28:24 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:24 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 Sep 10 20:28:24 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:24 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7" returned: 0 in 0.267s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:24 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.info Sep 10 20:28:24 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:24 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94" returned: 0 in 0.357s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:24 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:24 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94 Sep 10 20:28:24 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:25 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.info" returned: 0 in 0.244s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:25 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.info is being set with open permissions: ugo+rw Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:25 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.info Sep 10 20:28:25 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:25 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106.d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94" returned: 0 in 0.252s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94" released by "_delete_snapshot" :: held 1.439s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-d78f915b-37c7-4b09-acc4-7f42449ec106" released by "delete_snapshot" :: held 1.461s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Created reservations ['50507a50-1e74-42c7-9af1-e3b768da5e7f', '92e632e0-abc9-4c5d-8160-d02a206f9b2f', '7347f600-31d6-4434-a688-ece5d2e05b86', 'd51dbc64-22d2-4fc3-8e32-989d8a9da827'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:25 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Delete snapshot completed successfully. Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4794a6e8-0f44-4e3b-858e-afcd6ed802f5 tempest-ProjectMemberTests-995511774 None] Lock "cinder-d20c1bfd-8cb1-4a1c-a50b-6a4cc53cbf94-delete_snapshot" released by "delete_snapshot" :: held 1.606s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:25 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.info" returned: 0 in 0.271s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:25 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-03a93bca-2426-4b10-a11f-da6d717a8d32 tempest-SnapshotDependencyTests-126443036 None] Create snapshot completed successfully Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-d78f915b-37c7-4b09-acc4-7f42449ec106-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Lock "cinder-d78f915b-37c7-4b09-acc4-7f42449ec106-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-d78f915b-37c7-4b09-acc4-7f42449ec106" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:25 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-d78f915b-37c7-4b09-acc4-7f42449ec106" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[166369b2-a338-4c5f-a459-f1baf00a296d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:26 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 Sep 10 20:28:26 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:26 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106" returned: 0 in 0.359s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:26 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106 Sep 10 20:28:26 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:26 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-d78f915b-37c7-4b09-acc4-7f42449ec106" returned: 0 in 0.260s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-d78f915b-37c7-4b09-acc4-7f42449ec106" released by "delete_volume" :: held 0.678s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Created reservations ['1fe3bf8d-7eeb-4dc7-b3bd-2949384c4894', 'c259412f-cc57-488f-a139-75f3aba51726', 'cc9b41f7-d49a-4f9c-bf05-cca9a5c245b4', '0efa0a8b-da4c-4891-ac64-550eca5b719b'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:26 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:26 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:26 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:27 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.290s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:27 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Deleted volume successfully. Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-9e554360-a967-403d-b5c7-e4e0965c1c28 tempest-ProjectMemberTests-995511774 None] Lock "cinder-d78f915b-37c7-4b09-acc4-7f42449ec106-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Flow 'volume_create_manager' (b7eacd12-e51a-41b6-a5d9-0f8ee296dfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b57a6cc-ce93-4ecc-b17a-751c58503435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b57a6cc-ce93-4ecc-b17a-751c58503435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5d1275-af87-4a34-8f97-a818c4570d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68aae88145e49a3af2ad5baa9953b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ea277bb-ba8b-4034-bdac-a796cafeb4f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:27Z,use_quota=True,user_id='9f1c749c574c412da90f852d3fb2fbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bc5181-c4e4-4925-bec0-acf26edcd5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bc5181-c4e4-4925-bec0-acf26edcd5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fb7c28-2c64-4216-9f07-d0d9f34bdc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fb7c28-2c64-4216-9f07-d0d9f34bdc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec5d1275-af87-4a34-8f97-a818c4570d6a', 'volume_name': 'volume-ec5d1275-af87-4a34-8f97-a818c4570d6a', 'volume_size': 1, 'snapshot_id': '9ea277bb-ba8b-4034-bdac-a796cafeb4f7'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ae26cb-1e83-4480-b11e-6abfc5b5bdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ae26cb-1e83-4480-b11e-6abfc5b5bdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bfb208-4f2a-47f7-9eec-5a81b1a5ee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Volume ec5d1275-af87-4a34-8f97-a818c4570d6a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec5d1275-af87-4a34-8f97-a818c4570d6a', 'volume_size': 1, 'snapshot_id': '9ea277bb-ba8b-4034-bdac-a796cafeb4f7'} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "cinder-quobyte-9ea277bb-ba8b-4034-bdac-a796cafeb4f7-ec5d1275-af87-4a34-8f97-a818c4570d6a" by "_create_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-9ea277bb-ba8b-4034-bdac-a796cafeb4f7-ec5d1275-af87-4a34-8f97-a818c4570d6a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Creating volume ec5d1275-af87-4a34-8f97-a818c4570d6a from snapshot 9ea277bb-ba8b-4034-bdac-a796cafeb4f7 {{(pid=88137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "cinder-quobyte-ec5d1275-af87-4a34-8f97-a818c4570d6a" by "_copy_volume_from_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-ec5d1275-af87-4a34-8f97-a818c4570d6a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] snapshot: 9ea277bb-ba8b-4034-bdac-a796cafeb4f7, volume: ec5d1275-af87-4a34-8f97-a818c4570d6a, {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cab61e-22e4-4b91-a3f2-2580a0a961bd]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:27 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 Sep 10 20:28:27 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (eb7e6bab-ad1c-4fee-98a2-4fc17852b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc61e003-73da-4e06-b892-f9009d5ee52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc61e003-73da-4e06-b892-f9009d5ee52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699345879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b8debb-96c0-4d62-84c4-058f208d3cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:27Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0e31af-5714-4b93-9f96-4f1b9e307ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0e31af-5714-4b93-9f96-4f1b9e307ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68bca2f-820c-4171-a584-5c6957cea0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68bca2f-820c-4171-a584-5c6957cea0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b8debb-96c0-4d62-84c4-058f208d3cd1', 'volume_name': 'volume-20b8debb-96c0-4d62-84c4-058f208d3cd1', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4867fa-d7e1-4328-a96b-928e856a0223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4867fa-d7e1-4328-a96b-928e856a0223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae71e202-89da-4c8d-bf7f-77d6f9b9cffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:27 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Volume 20b8debb-96c0-4d62-84c4-058f208d3cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b8debb-96c0-4d62-84c4-058f208d3cd1', 'volume_size': 1} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:27 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7" returned: 0 in 0.376s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fc6ed14-8b79-4954-b65d-516c7db502be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b14327-8bc3-4736-8a8c-49f2ed24fe7d]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:27 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:27 devstack sudo[109622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be Sep 10 20:28:27 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:28 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be" returned: 0 in 0.369s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] will copy from snapshot at /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 10 20:28:28 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Creating direct copy from snapshot {{(pid=88137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 10 20:28:28 devstack cinder-volume[88137]: DEBUG cinder.utils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Path /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a not found in is_blk_device check {{(pid=88137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 20:28:28 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:28 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a Sep 10 20:28:28 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:32 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a" returned: 0 in 4.348s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.image.image_utils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Image conversion details: src /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be, size 1024.00 MB, duration 4.35 sec, destination /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a {{(pid=88137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 20:28:32 devstack cinder-volume[88137]: INFO cinder.image.image_utils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Converted 1024.00 MB image at 235.42 MB/s Sep 10 20:28:32 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a is being set with open permissions: ugo+rw Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:32 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a Sep 10 20:28:32 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:32 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a" returned: 0 in 0.244s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-ec5d1275-af87-4a34-8f97-a818c4570d6a" released by "_copy_volume_from_snapshot" :: held 5.419s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-9ea277bb-ba8b-4034-bdac-a796cafeb4f7-ec5d1275-af87-4a34-8f97-a818c4570d6a" released by "_create_volume_from_snapshot" :: held 5.482s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.500s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.101s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699345879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b8debb-96c0-4d62-84c4-058f208d3cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2955575c5206441b8d457ca179806365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:27Z,use_quota=True,user_id='ca243b7554944241a4e871ec1d71d10f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Creating volume 20b8debb-96c0-4d62-84c4-058f208d3cd1 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:32 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:32 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 1073741824 Sep 10 20:28:32 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bfb208-4f2a-47f7-9eec-5a81b1a5ee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5d1275-af87-4a34-8f97-a818c4570d6a', 'volume_size': 1, 'snapshot_id': '9ea277bb-ba8b-4034-bdac-a796cafeb4f7'}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1399399e-eb8a-4db7-9533-4a1787cd4b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:32 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Volume volume-ec5d1275-af87-4a34-8f97-a818c4570d6a (ec5d1275-af87-4a34-8f97-a818c4570d6a): created successfully Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1399399e-eb8a-4db7-9533-4a1787cd4b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:32 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Flow 'volume_create_manager' (b7eacd12-e51a-41b6-a5d9-0f8ee296dfcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:32 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-33a58493-378f-494e-9179-6440b0efb6a4 tempest-SnapshotDependencyTests-126443036 None] Created volume successfully. Sep 10 20:28:33 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 1073741824" returned: 0 in 0.402s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:33 devstack sudo[109687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 Sep 10 20:28:33 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:33 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1" returned: 0 in 0.239s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae71e202-89da-4c8d-bf7f-77d6f9b9cffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b8debb-96c0-4d62-84c4-058f208d3cd1', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5097ee-ba6f-4fcc-8fb3-e931e8ed958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:33 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Volume volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 (20b8debb-96c0-4d62-84c4-058f208d3cd1): created successfully Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5097ee-ba6f-4fcc-8fb3-e931e8ed958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Flow 'volume_create_manager' (eb7e6bab-ad1c-4fee-98a2-4fc17852b68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:33 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-52971bde-66d5-41ed-bde6-b7095ee00c3a tempest-ProjectMemberTests-995511774 None] Created volume successfully. Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "cinder-9ea277bb-ba8b-4034-bdac-a796cafeb4f7-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-9ea277bb-ba8b-4034-bdac-a796cafeb4f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "cinder-quobyte-9fc6ed14-8b79-4954-b65d-516c7db502be" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-9fc6ed14-8b79-4954-b65d-516c7db502be" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "cinder-quobyte-9ea277bb-ba8b-4034-bdac-a796cafeb4f7" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-9ea277bb-ba8b-4034-bdac-a796cafeb4f7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Deleting offline snapshot 9ea277bb-ba8b-4034-bdac-a796cafeb4f7 of volume 9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] snapshot_file for this snap is: volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[480db358-c01f-490d-8bf4-e6784f09ca9f]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:33 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:33 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 Sep 10 20:28:33 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:34 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7" returned: 0 in 0.359s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fc6ed14-8b79-4954-b65d-516c7db502be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f487d7-68b5-4f73-abec-f613f5d4e2af]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Creating offline snapshot 3def2744-3a5a-4477-8169-3b3d24d30671 of volume 20b8debb-96c0-4d62-84c4-058f208d3cd1 {{(pid=88137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cdebf6-a7ea-45d7-9ff1-01ca171d74eb]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:34 devstack sudo[109697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be Sep 10 20:28:34 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:34 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 Sep 10 20:28:34 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:34 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1" returned: 0 in 0.367s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 1G {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:34 devstack sudo[109709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 1G Sep 10 20:28:34 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:34 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be" returned: 0 in 0.537s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:34 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:34 devstack sudo[109715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 Sep 10 20:28:34 devstack sudo[109715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:35 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 1G" returned: 0 in 0.408s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:35 devstack sudo[109715]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7" returned: 0 in 0.342s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:35 devstack sudo[109724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:35 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:35 devstack sudo[109726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7 Sep 10 20:28:35 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:35 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 -F qcow2 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671" returned: 0 in 0.287s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:35 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 is being set with open permissions: ugo+rw Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:35 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be.9ea277bb-ba8b-4034-bdac-a796cafeb4f7" returned: 0 in 0.272s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:35 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 Sep 10 20:28:35 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-9ea277bb-ba8b-4034-bdac-a796cafeb4f7" released by "_delete_snapshot" :: held 1.618s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-9fc6ed14-8b79-4954-b65d-516c7db502be" released by "delete_snapshot" :: held 1.642s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Created reservations ['1c5d85d9-564d-4f41-90ac-c4bd581fd22d', '050588e3-8587-43c2-84a6-e3318c553756', '71118e75-9901-48b0-abde-ec0cec71ad63', '732730f6-f7dc-40f3-b538-bea522306326'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:35 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Delete snapshot completed successfully. Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-713c9f1d-dcdd-4ce4-9fd7-8f88a37b1c91 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-9ea277bb-ba8b-4034-bdac-a796cafeb4f7-delete_snapshot" released by "delete_snapshot" :: held 1.778s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:35 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671" returned: 0 in 0.263s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:35 devstack sudo[109735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.info Sep 10 20:28:35 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:35 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.info" returned: 0 in 0.245s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:35 devstack cinder-volume[88137]: WARNING cinder.volume.drivers.remotefs [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.info is being set with open permissions: ugo+rw Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.info {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:35 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.info Sep 10 20:28:35 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "cinder-9fc6ed14-8b79-4954-b65d-516c7db502be-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-9fc6ed14-8b79-4954-b65d-516c7db502be-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "cinder-quobyte-9fc6ed14-8b79-4954-b65d-516c7db502be" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-9fc6ed14-8b79-4954-b65d-516c7db502be" acquired by "delete_volume" :: waited 0.021s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1278fb2e-5aa2-410b-a3f2-af0fdcfca3e2]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:35 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:36 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.info" returned: 0 in 0.252s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:36 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be Sep 10 20:28:36 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:36 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-97dce2a1-a1cd-4ee6-9153-ceb68cd9f89b tempest-ProjectMemberTests-995511774 None] Create snapshot completed successfully Sep 10 20:28:36 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be" returned: 0 in 0.373s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:36 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be Sep 10 20:28:36 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-3def2744-3a5a-4477-8169-3b3d24d30671-delete_snapshot" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Lock "cinder-3def2744-3a5a-4477-8169-3b3d24d30671-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-20b8debb-96c0-4d62-84c4-058f208d3cd1" by "delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-20b8debb-96c0-4d62-84c4-058f208d3cd1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-3def2744-3a5a-4477-8169-3b3d24d30671" by "_delete_snapshot" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-3def2744-3a5a-4477-8169-3b3d24d30671" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Deleting offline snapshot 3def2744-3a5a-4477-8169-3b3d24d30671 of volume 20b8debb-96c0-4d62-84c4-058f208d3cd1 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] snapshot_file for this snap is: volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 {{(pid=88137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bd629b-0c0b-448f-9276-82f146c6e073]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:36 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-9fc6ed14-8b79-4954-b65d-516c7db502be" returned: 0 in 0.261s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:36 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 Sep 10 20:28:36 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-9fc6ed14-8b79-4954-b65d-516c7db502be" released by "delete_volume" :: held 0.689s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Created reservations ['76fd1956-e66d-47ed-a46c-fe07dd7fca33', 'f7d9128b-0e59-4f35-bc2d-d7b2ac1b06c8', '751d686f-889b-451a-8b86-f717aabf71e4', '04095830-258e-41bd-8e2e-bb49805b97d7'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:36 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:36 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:36 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671" returned: 0 in 0.371s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b8debb-96c0-4d62-84c4-058f208d3cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e305173-fcc9-47a0-8162-c95a02afaf16]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:36 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:37 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.259s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:37 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Deleted volume successfully. Sep 10 20:28:37 devstack sudo[109756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 Sep 10 20:28:37 devstack sudo[109756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-7be26ba6-69dc-4ae9-8a36-44376e19e80f tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-9fc6ed14-8b79-4954-b65d-516c7db502be-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "cinder-ec5d1275-af87-4a34-8f97-a818c4570d6a-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-ec5d1275-af87-4a34-8f97-a818c4570d6a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "cinder-quobyte-ec5d1275-af87-4a34-8f97-a818c4570d6a" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-ec5d1275-af87-4a34-8f97-a818c4570d6a" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd968f3-ead7-475f-8df6-dd39e6169823]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:37 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a Sep 10 20:28:37 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:37 devstack sudo[109756]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1" returned: 0 in 0.384s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:37 devstack sudo[109764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 Sep 10 20:28:37 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:37 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a" returned: 0 in 0.380s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:37 devstack sudo[109772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a Sep 10 20:28:37 devstack sudo[109772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:37 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671" returned: 0 in 0.343s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:37 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671 Sep 10 20:28:37 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:37 devstack sudo[109772]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-ec5d1275-af87-4a34-8f97-a818c4570d6a" returned: 0 in 0.259s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-quobyte-ec5d1275-af87-4a34-8f97-a818c4570d6a" released by "delete_volume" :: held 0.678s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Created reservations ['e10d0f4f-3c69-42c5-a672-f350a5e7936e', '2044a438-db34-47fb-b587-311970a27ee6', 'a332703a-4831-49c9-91ca-fd715c6ea422', 'c8715e98-907a-462f-b35a-3dcf01bb7a36'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:37 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1.3def2744-3a5a-4477-8169-3b3d24d30671" returned: 0 in 0.245s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-3def2744-3a5a-4477-8169-3b3d24d30671" released by "_delete_snapshot" :: held 1.442s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-20b8debb-96c0-4d62-84c4-058f208d3cd1" released by "delete_snapshot" :: held 1.468s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:37 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:38 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:38 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Created reservations ['5e569d4f-b980-4956-a695-b41173da2c3b', 'c295dede-7178-4ca6-a848-90984066cdeb', 'b273f8f7-0851-404b-afde-ec2cdc4dabf9', '896e8e29-631e-48db-8f2e-856f0b551ab8'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Delete snapshot completed successfully. Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-e2ad4af3-b89c-44c6-b930-b58309c87769 tempest-ProjectMemberTests-995511774 None] Lock "cinder-3def2744-3a5a-4477-8169-3b3d24d30671-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:38 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.257s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:38 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Deleted volume successfully. Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-6872cb09-0855-4c43-a75d-adc1abe96cf9 tempest-SnapshotDependencyTests-126443036 None] Lock "cinder-ec5d1275-af87-4a34-8f97-a818c4570d6a-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-20b8debb-96c0-4d62-84c4-058f208d3cd1-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Lock "cinder-20b8debb-96c0-4d62-84c4-058f208d3cd1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Acquiring lock "cinder-quobyte-20b8debb-96c0-4d62-84c4-058f208d3cd1" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-20b8debb-96c0-4d62-84c4-058f208d3cd1" acquired by "delete_volume" :: waited 0.016s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[42675ffc-78a3-474c-9694-2eb213fbc0e5]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:38 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:38 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 Sep 10 20:28:38 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:39 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1" returned: 0 in 0.389s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:39 devstack sudo[109786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1 Sep 10 20:28:39 devstack sudo[109786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:39 devstack sudo[109786]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-20b8debb-96c0-4d62-84c4-058f208d3cd1" returned: 0 in 0.242s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Lock "cinder-quobyte-20b8debb-96c0-4d62-84c4-058f208d3cd1" released by "delete_volume" :: held 0.687s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Created reservations ['280555b4-6905-4de1-ad0f-22c6fe85007b', '286ea28d-3093-4388-b403-cda480c1270d', '592e2a52-0e61-4a79-939a-ff22bbc1be83', 'a2a19378-ac82-485f-b8a0-1a06d1b3104c'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:39 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:39 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:39 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.303s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:39 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Deleted volume successfully. Sep 10 20:28:39 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-4ec077c7-5b92-4bcc-8dcc-196107c65282 tempest-ProjectMemberTests-995511774 None] Lock "cinder-20b8debb-96c0-4d62-84c4-058f208d3cd1-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:49 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=46,cinder:UPDATE=63,cinder:DELETE=6,cinder:INSERT=19 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:28:49 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=62,cinder:DELETE=5,cinder:SELECT=54,cinder:INSERT=15 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Flow 'volume_create_manager' (f85c65ed-a560-40dc-b2a1-eb564359debd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9015da21-bb4b-410b-860b-2d3cb2ead86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9015da21-bb4b-410b-860b-2d3cb2ead86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1256340933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cd371e-d83d-45c1-959e-f4bcdb4fe968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e8ddb279654a1a86fb20975ecf4d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:51Z,use_quota=True,user_id='f325c540af0a4b97807b3858f2391138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813a3c7d-d156-41c2-a8e6-f6c6027a2d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813a3c7d-d156-41c2-a8e6-f6c6027a2d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b762102-ce46-4b6d-98a0-ab5f2cbc2338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b762102-ce46-4b6d-98a0-ab5f2cbc2338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44cd371e-d83d-45c1-959e-f4bcdb4fe968', 'volume_name': 'volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922f7bea-8a7a-4a29-b802-705b8eab251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922f7bea-8a7a-4a29-b802-705b8eab251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fa636d-f9ef-45df-a399-d380d17fb26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Volume 44cd371e-d83d-45c1-959e-f4bcdb4fe968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968', 'volume_size': 1} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1256340933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cd371e-d83d-45c1-959e-f4bcdb4fe968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e8ddb279654a1a86fb20975ecf4d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:51Z,use_quota=True,user_id='f325c540af0a4b97807b3858f2391138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Creating volume 44cd371e-d83d-45c1-959e-f4bcdb4fe968 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:51 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:51 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 1073741824 Sep 10 20:28:51 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:51 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 1073741824" returned: 0 in 0.395s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:51 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 Sep 10 20:28:51 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:51 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968" returned: 0 in 0.236s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fa636d-f9ef-45df-a399-d380d17fb26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029bb960-2759-4ad1-a027-3b3c87475e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:51 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Volume volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 (44cd371e-d83d-45c1-959e-f4bcdb4fe968): created successfully Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029bb960-2759-4ad1-a027-3b3c87475e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:51 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Flow 'volume_create_manager' (f85c65ed-a560-40dc-b2a1-eb564359debd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:51 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-68864a8e-0f01-44f4-8f7b-361a75b8bce0 tempest-ProjectReaderTests-798272963 None] Created volume successfully. Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Acquiring lock "cinder-44cd371e-d83d-45c1-959e-f4bcdb4fe968-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Lock "cinder-44cd371e-d83d-45c1-959e-f4bcdb4fe968-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Acquiring lock "cinder-quobyte-44cd371e-d83d-45c1-959e-f4bcdb4fe968" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Lock "cinder-quobyte-44cd371e-d83d-45c1-959e-f4bcdb4fe968" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3126f7f8-ae61-4e48-9e79-b34d3d035acd]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:52 devstack sudo[109806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 Sep 10 20:28:52 devstack sudo[109806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:52 devstack sudo[109806]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968" returned: 0 in 0.345s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:52 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968 Sep 10 20:28:52 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:52 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-44cd371e-d83d-45c1-959e-f4bcdb4fe968" returned: 0 in 0.244s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:52 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Lock "cinder-quobyte-44cd371e-d83d-45c1-959e-f4bcdb4fe968" released by "delete_volume" :: held 0.624s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Created reservations ['94a39995-f58a-4946-abe5-d7241ab7337d', '1e5f190a-b829-4974-a796-71021202c7a2', '3928c46d-6e4d-40cb-bc16-43efc43b5d7f', '0499ca92-823a-4453-9a04-d86f14b28493'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:53 devstack sudo[109814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:53 devstack sudo[109814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:53 devstack sudo[109814]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.242s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:53 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Deleted volume successfully. Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-40ec349f-14ce-4d21-aa66-e34f24bb7f7b tempest-ProjectReaderTests-798272963 None] Lock "cinder-44cd371e-d83d-45c1-959e-f4bcdb4fe968-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Flow 'volume_create_manager' (5ab81cb1-3b5a-457f-a688-3d4dad309b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264137cd-3e70-45ef-b8b2-5654c99251dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264137cd-3e70-45ef-b8b2-5654c99251dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-452630657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13c2ac3-f942-433c-bdd9-2e698346443e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e8ddb279654a1a86fb20975ecf4d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:54Z,use_quota=True,user_id='f325c540af0a4b97807b3858f2391138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec6b4e1-9892-45ab-8039-65d3d1503ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec6b4e1-9892-45ab-8039-65d3d1503ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cf84f3-6db0-4df3-9c18-3ffaf48e7c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cf84f3-6db0-4df3-9c18-3ffaf48e7c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a13c2ac3-f942-433c-bdd9-2e698346443e', 'volume_name': 'volume-a13c2ac3-f942-433c-bdd9-2e698346443e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef04ebbe-88e0-4414-a9d8-a4d26c21acc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef04ebbe-88e0-4414-a9d8-a4d26c21acc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476fc3f2-59c8-41d8-b4dd-2a3753cfeaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:53 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Volume a13c2ac3-f942-433c-bdd9-2e698346443e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a13c2ac3-f942-433c-bdd9-2e698346443e', 'volume_size': 1} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-452630657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13c2ac3-f942-433c-bdd9-2e698346443e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e8ddb279654a1a86fb20975ecf4d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:54Z,use_quota=True,user_id='f325c540af0a4b97807b3858f2391138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Creating volume a13c2ac3-f942-433c-bdd9-2e698346443e {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:53 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:53 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:53 devstack sudo[109817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e 1073741824 Sep 10 20:28:53 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:54 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e 1073741824" returned: 0 in 0.401s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:54 devstack sudo[109822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e Sep 10 20:28:54 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:54 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e" returned: 0 in 0.235s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476fc3f2-59c8-41d8-b4dd-2a3753cfeaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13c2ac3-f942-433c-bdd9-2e698346443e', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1123cd08-ebd0-48cc-992b-607bfa85ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:54 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Volume volume-a13c2ac3-f942-433c-bdd9-2e698346443e (a13c2ac3-f942-433c-bdd9-2e698346443e): created successfully Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1123cd08-ebd0-48cc-992b-607bfa85ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Flow 'volume_create_manager' (5ab81cb1-3b5a-457f-a688-3d4dad309b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:54 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-570f248c-0ca8-4a26-9bc7-cbba612d0c4e tempest-ProjectReaderTests-798272963 None] Created volume successfully. Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Acquiring lock "cinder-a13c2ac3-f942-433c-bdd9-2e698346443e-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Lock "cinder-a13c2ac3-f942-433c-bdd9-2e698346443e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Acquiring lock "cinder-quobyte-a13c2ac3-f942-433c-bdd9-2e698346443e" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:54 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Lock "cinder-quobyte-a13c2ac3-f942-433c-bdd9-2e698346443e" acquired by "delete_volume" :: waited 0.013s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[607bbda9-423c-499e-93a9-e169118dc574]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:55 devstack sudo[109825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e Sep 10 20:28:55 devstack sudo[109825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:55 devstack sudo[109825]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e" returned: 0 in 0.341s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:55 devstack sudo[109830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e Sep 10 20:28:55 devstack sudo[109830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:55 devstack sudo[109830]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-a13c2ac3-f942-433c-bdd9-2e698346443e" returned: 0 in 0.233s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Lock "cinder-quobyte-a13c2ac3-f942-433c-bdd9-2e698346443e" released by "delete_volume" :: held 0.612s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Created reservations ['17b9faea-ee87-4a96-83c9-48782abfbf39', '8797867e-9c94-4340-9fe9-19e91a91f224', '40a2c096-fa02-46fb-9b64-2d29bcbd7b58', '667b1b98-ba54-482d-bbbd-7708c409ce52'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:55 devstack sudo[109833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:55 devstack sudo[109833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:55 devstack sudo[109833]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.249s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:55 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Deleted volume successfully. Sep 10 20:28:55 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-46b9966b-bc2a-4e65-94e2-830dfdc237d0 tempest-ProjectReaderTests-798272963 None] Lock "cinder-a13c2ac3-f942-433c-bdd9-2e698346443e-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Flow 'volume_create_manager' (134ec241-866d-4fe7-af14-39c2ec7d4d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9b556e-8707-4a5b-8718-1e48b2a1ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9b556e-8707-4a5b-8718-1e48b2a1ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843368487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e8ddb279654a1a86fb20975ecf4d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:56Z,use_quota=True,user_id='f325c540af0a4b97807b3858f2391138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64de21e1-f838-49c3-98de-db47fadb09a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64de21e1-f838-49c3-98de-db47fadb09a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a810c92-463a-48a6-8c8a-6796a1c8f45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a810c92-463a-48a6-8c8a-6796a1c8f45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec', 'volume_name': 'volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dd7d05-c58c-40a5-a49c-0bdb873c6aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dd7d05-c58c-40a5-a49c-0bdb873c6aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709ee84a-b4f4-41ef-83c3-2c1c0574c877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:56 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Volume 6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec', 'volume_size': 1} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843368487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e8ddb279654a1a86fb20975ecf4d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:56Z,use_quota=True,user_id='f325c540af0a4b97807b3858f2391138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Creating volume 6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:56 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:56 devstack sudo[109836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec 1073741824 Sep 10 20:28:56 devstack sudo[109836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:56 devstack sudo[109836]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:56 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec 1073741824" returned: 0 in 0.412s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:57 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec Sep 10 20:28:57 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:57 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec" returned: 0 in 0.237s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709ee84a-b4f4-41ef-83c3-2c1c0574c877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1201ff6b-d2b0-4bbf-bf8c-958810228d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:57 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Volume volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec (6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec): created successfully Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1201ff6b-d2b0-4bbf-bf8c-958810228d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Flow 'volume_create_manager' (134ec241-866d-4fe7-af14-39c2ec7d4d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:57 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-64dce4dd-36e7-41bf-b285-d0ab42cae396 tempest-ProjectReaderTests-798272963 None] Created volume successfully. Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Acquiring lock "cinder-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Lock "cinder-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Acquiring lock "cinder-quobyte-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Lock "cinder-quobyte-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec" acquired by "delete_volume" :: waited 0.015s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[37308545-452f-467c-af7c-965effbbe7aa]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:57 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec Sep 10 20:28:57 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:57 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec" returned: 0 in 0.349s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:57 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:58 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec Sep 10 20:28:58 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:58 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec" returned: 0 in 0.240s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Lock "cinder-quobyte-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec" released by "delete_volume" :: held 0.625s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Created reservations ['5c579610-c154-4817-ab86-a9ff9fd40699', '0f8b5dc6-5b69-4e0a-b54d-166801aaf290', '34e901f6-de94-47fe-96ef-928224116a37', '768be5f4-a293-4f22-9a18-d35f33312543'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:58 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:28:58 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:58 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.249s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:28:58 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Deleted volume successfully. Sep 10 20:28:58 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-c2c56c25-4252-4d20-9bb8-0fbf27b49e66 tempest-ProjectReaderTests-798272963 None] Lock "cinder-6a9dc7da-09ef-49f3-8e9d-3f117c8b37ec-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Flow 'volume_create_manager' (756730e8-ede8-4992-bef6-6b1143f11f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc3345d-cc57-4231-a00a-66c4b9a25f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc3345d-cc57-4231-a00a-66c4b9a25f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-778387994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff77f9e-6959-443d-8cf8-d9f329ab9b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e8ddb279654a1a86fb20975ecf4d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:59Z,use_quota=True,user_id='f325c540af0a4b97807b3858f2391138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b108d062-b3e4-4ee7-954f-73ba87d0a489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b108d062-b3e4-4ee7-954f-73ba87d0a489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a548775-8d7f-41a6-a0ae-382840bfac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a548775-8d7f-41a6-a0ae-382840bfac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff77f9e-6959-443d-8cf8-d9f329ab9b38', 'volume_name': 'volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4545832-ad8e-4dbb-bec6-bdcf5eb68abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4545832-ad8e-4dbb-bec6-bdcf5eb68abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4a786e-f550-47da-a786-7ae500acde0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:59 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Volume dff77f9e-6959-443d-8cf8-d9f329ab9b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38', 'volume_size': 1} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T18:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-778387994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff77f9e-6959-443d-8cf8-d9f329ab9b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e8ddb279654a1a86fb20975ecf4d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T18:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T18:28:59Z,use_quota=True,user_id='f325c540af0a4b97807b3858f2391138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ede4d0ef-9212-4f18-9d2a-78754e94a205),volume_type_id=ede4d0ef-9212-4f18-9d2a-78754e94a205)}" {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.remotefs [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Creating volume dff77f9e-6959-443d-8cf8-d9f329ab9b38 {{(pid=88137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Selected osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 as target Quobyte volume. {{(pid=88137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 10 20:28:59 devstack cinder-volume[88137]: INFO cinder.volume.drivers.remotefs [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] casted to osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8 Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 1073741824 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:59 devstack sudo[109856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 1073741824 Sep 10 20:28:59 devstack sudo[109856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:59 devstack sudo[109856]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 1073741824" returned: 0 in 0.404s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:28:59 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 Sep 10 20:28:59 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:28:59 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38" returned: 0 in 0.241s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'} {{(pid=88137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4a786e-f550-47da-a786-7ae500acde0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38', 'volume_size': 1}' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311e0c6b-ba5e-4d7e-ac0c-7af44d34849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 20:28:59 devstack cinder-volume[88137]: INFO cinder.volume.flows.manager.create_volume [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Volume volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 (dff77f9e-6959-443d-8cf8-d9f329ab9b38): created successfully Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311e0c6b-ba5e-4d7e-ac0c-7af44d34849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 20:28:59 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Flow 'volume_create_manager' (756730e8-ede8-4992-bef6-6b1143f11f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 20:28:59 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-1dc38ba7-bf0f-451a-b9b0-d201d5950368 tempest-ProjectReaderTests-798272963 None] Created volume successfully. Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Acquiring lock "cinder-dff77f9e-6959-443d-8cf8-d9f329ab9b38-delete_volume" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Lock "cinder-dff77f9e-6959-443d-8cf8-d9f329ab9b38-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Acquiring lock "cinder-quobyte-dff77f9e-6959-443d-8cf8-d9f329ab9b38" by "delete_volume" {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Lock "cinder-quobyte-dff77f9e-6959-443d-8cf8-d9f329ab9b38" acquired by "delete_volume" :: waited 0.014s {{(pid=88137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f253a88-8898-4593-9aa3-ddb354b19dce]: (4, 'qcow2') {{(pid=89779) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:29:00 devstack sudo[109864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 Sep 10 20:29:00 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:29:00 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38" returned: 0 in 0.352s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:29:00 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38 Sep 10 20:29:00 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:29:00 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32/volume-dff77f9e-6959-443d-8cf8-d9f329ab9b38" returned: 0 in 0.244s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Lock "cinder-quobyte-dff77f9e-6959-443d-8cf8-d9f329ab9b38" released by "delete_volume" :: held 0.631s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG cinder.quota [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Created reservations ['e175c385-cba9-4234-96d1-6c6191376e97', '34759803-c7ce-4ffd-8b68-683035253653', 'dc19b848-c4b7-422d-96dd-fe3854b7eccd', 'fa601439-d68d-416c-a31f-db0fc89df62b'] {{(pid=88137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:29:00 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:29:00 devstack sudo[109872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:29:00 devstack sudo[109872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:29:01 devstack sudo[109872]: pam_unix(sudo:session): session closed for user root Sep 10 20:29:01 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.234s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:29:01 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:29:01 devstack cinder-volume[88137]: INFO cinder.volume.manager [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Deleted volume successfully. Sep 10 20:29:01 devstack cinder-volume[88137]: DEBUG cinder.coordination [None req-36e6f90d-a57c-4b2b-8de9-ddf35f7c3d0c tempest-ProjectReaderTests-798272963 None] Lock "cinder-dff77f9e-6959-443d-8cf8-d9f329ab9b38-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=88137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 20:29:10 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:UPDATE=45,cinder:SELECT=27,cinder:INSERT=12,cinder:DELETE=4 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:29:11 devstack cinder-volume[88137]: DEBUG dbcounter [-] [88137] Writing DB stats cinder:SELECT=29,cinder:INSERT=8,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=88137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8': None} {{(pid=88137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG cinder.volume.drivers.quobyte [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8cb09d7-531c-4884-8213-814a45180ea8'] {{(pid=88137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.lockutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 20:29:20 devstack sudo[110129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32 Sep 10 20:29:20 devstack sudo[110129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 20:29:20 devstack sudo[110129]: pam_unix(sudo:session): session closed for user root Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG oslo_concurrency.processutils [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/719876a0d7b756d82a23866de243ab32" returned: 0 in 0.256s {{(pid=88137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG cinder.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Notifying Schedulers of capabilities ... {{(pid=88137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG oslo_service.periodic_task [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] Running periodic task VolumeManager._thread_info {{(pid=88137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread count: 29 {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 20:29:20 devstack cinder-volume[88137]: DEBUG cinder.volume.manager [None req-d17309e4-4fd3-4e9a-aa78-055247184ffa None None] thread info: [<_MainThread(MainThread, started 140089617191040)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}